Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5188 originally caused by: Started by upstream project "master-osmo-pcu" build number 5351 originally caused by: Started by upstream project "master-libosmo-gprs" build number 132 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17650 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29256 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5149 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30031 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9237 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5188 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3906 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins414801287113650640.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 05:27:51 + trial_dir_prefix=trial- + rm -rf trial-2354 trial-2354-bin.tgz trial-2354-run.tgz + trial_dir=trial-2355 + mkdir -p trial-2355 + mv open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2943.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2355 + cat open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2943.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2943.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29256.md5 osmo-nitb.build-12964.md5 osmo-pcu-oc2g.build-3906.md5 osmo-pcu-sysmo.build-5188.md5 osmo-pcu.build-5149.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2355 combinations: None trial: 'trial-2355' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2355 -------------------------------------------------------------------------------------------- 05:28:02.668868 tst trial-2355: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/log --------------------------------------------------------------------- trial-2355 nitb_sms:sysmo --------------------------------------------------------------------- 05:30:11.488114 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:11.493089 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 05:30:11.514911 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 05:30:11.522002 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 05:30:11.575785 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 05:30:11.597264 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 05:30:11.604257 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 05:30:12.144532 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:30:12.149748 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 05:30:12.160837 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 05:30:12.545367 tst mo_mt_sms.py: using LAC 19259 05:30:12.790948 tst mo_mt_sms.py: using RAC 134 05:30:12.915865 tst mo_mt_sms.py: using CellId 19259 05:30:13.039635 tst mo_mt_sms.py: using BVCI 19260 05:30:13.154818 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:30:13.335571 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 05:30:13.456346 tst mo_mt_sms.py:9: start nitb and bts... 05:30:13.675604 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:30:16.048146 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28996): Launched 05:30:16.379048 run osmo-nitb_10.42.42.2(pid=28997): Launched 05:30:16.572224 run osmo-nitb_10.42.42.2(pid=28997): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28997)] 05:30:16.704568 run osmo-nitb_10.42.42.2(pid=28997): stdout: | (launched: 2022-12-09_05:30:16.319542) 05:30:16.836684 run osmo-nitb_10.42.42.2(pid=28997): stderr: | (launched: 2022-12-09_05:30:16.366721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:16.968652 run osmo-nitb_10.42.42.2(pid=28997): stdout: | (launched: 2022-12-09_05:30:16.319542) 05:30:17.131803 run osmo-nitb_10.42.42.2(pid=28997): stderr: | (launched: 2022-12-09_05:30:16.366721) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:17.291100 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28997): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28997) [trial-2355↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28997)] [trial-2355↪nitb_sms:sysmo↪mo_mt_sms.py:11] 05:30:17.300387 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 05:30:17.307540 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28996): Terminating (SIGTERM) 05:30:17.519846 --- ParallelTerminationStrategy: PID 28996 died... 05:30:17.540684 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28996): Terminated: ok {rc=0} 05:30:17.630170 bus /sierra_3: Setting Powered False 05:30:18.733012 bus /sierra_3: Setting Powered False 05:30:19.851824 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:sysmo --------------------------------------------------------------------- 05:30:21.033889 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:21.038189 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 05:30:21.060016 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 05:30:21.088833 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 05:30:21.144519 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 05:30:21.166198 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 05:30:21.193442 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 05:30:21.740534 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:sysmo mo_mt_sms.py ---------------------------------------------- 05:30:21.745777 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:21.756777 tst sms:sysmo: Using 1 x bts (candidates: 1) 05:30:21.792513 tst mo_mt_sms.py: using LAC 19260 05:30:21.920424 tst mo_mt_sms.py: using RAC 135 05:30:22.048012 tst mo_mt_sms.py: using CellId 19260 05:30:22.176134 tst mo_mt_sms.py: using BVCI 19261 05:30:22.287661 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:22.298780 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:22.309426 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:22.320303 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:22.331015 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 05:30:22.341821 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:22.459724 tst sms:sysmo: Using 1 x modem (candidates: 2) 05:30:22.582709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:24.354634 run create_hlr_db(pid=29003): Launched 05:30:24.487878 bus /sierra_2: Setting Powered False 05:30:25.552445 run create_hlr_db(pid=29003): Terminated: ok {rc=0} 05:30:25.989365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29005): Launched 05:30:26.296275 run osmo-hlr_10.42.42.2(pid=29006): Launched 05:30:26.413720 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:28.887342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29008): Launched 05:30:29.194575 run osmo-stp_10.42.42.5(pid=29009): Launched 05:30:29.310892 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:34.671242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29011): Launched 05:30:34.977087 run osmo-msc_10.42.42.6(pid=29012): Launched 05:30:35.146930 run osmo-stp_10.42.42.5(pid=29009): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29009)] 05:30:35.275875 run osmo-stp_10.42.42.5(pid=29009): stdout: | (launched: 2022-12-09_05:30:29.136734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:35.405259 run osmo-stp_10.42.42.5(pid=29009): stderr: | 20221209053029311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053029311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053029311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053029312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053029312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053029312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053029312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:35.531665 run osmo-stp_10.42.42.5(pid=29009): stdout: | (launched: 2022-12-09_05:30:29.136734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:35.652094 run osmo-stp_10.42.42.5(pid=29009): stderr: | 20221209053029311 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053029311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053029311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053029312 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053029312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053029312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053029312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:35.796151 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29009): Process ended prematurely: osmo-stp_10.42.42.5(pid=29009) [trial-2355↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29009)] [trial-2355↪sms:sysmo↪mo_mt_sms.py:16] 05:30:35.804477 tst mo_mt_sms.py:16: Test FAILED (14.1 sec) 05:30:35.831250 run osmo-hlr_10.42.42.2(pid=29006): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29006)] 05:30:35.880031 run osmo-hlr_10.42.42.2(pid=29006): stdout: | (launched: 2022-12-09_05:30:26.238777) 05:30:35.930828 run osmo-hlr_10.42.42.2(pid=29006): stderr: | 20221209053026417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053026417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053026417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053026417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053026417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053026418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053026429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053026437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053026438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053026438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:36.001297 run osmo-msc_10.42.42.6(pid=29012): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29012)] 05:30:36.051176 run osmo-msc_10.42.42.6(pid=29012): stdout: | (launched: 2022-12-09_05:30:34.918960) 05:30:36.101934 run osmo-msc_10.42.42.6(pid=29012): stderr: | 20221209053035196 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053035196 DLGLOBAL DEBUG validating counter group 0x7fb90a71ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053035196 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053035196 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053035196 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053035197 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053035199 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053035199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053035200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053035200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:36.153594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29005): Terminating (SIGTERM) 05:30:36.194991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29008): Terminating (SIGTERM) 05:30:36.236046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29011): Terminating (SIGTERM) 05:30:36.277553 --- ParallelTerminationStrategy: PID 29005 died... 05:30:36.297024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29005): Terminated: ok {rc=0} 05:30:36.342169 --- ParallelTerminationStrategy: PID 29008 died... 05:30:36.361101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29008): Terminated: ok {rc=0} 05:30:36.406249 --- ParallelTerminationStrategy: PID 29011 died... 05:30:36.425033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29011): Terminated: ok {rc=0} 05:30:36.512900 bus /sierra_3: Setting Powered False 05:30:37.614164 bus /sierra_3: Setting Powered False 05:30:38.728306 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:sysmo --------------------------------------------------------------------- 05:30:39.978814 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:39.982855 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:30:40.004334 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 05:30:40.011364 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:30:40.048284 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:30:40.069486 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 05:30:40.076832 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:30:40.597312 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 05:30:40.602663 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 05:30:40.614037 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 05:30:40.651496 tst assert_extension.py: using LAC 19261 05:30:40.780162 tst assert_extension.py: using RAC 136 05:30:40.909451 tst assert_extension.py: using CellId 19261 05:30:41.040680 tst assert_extension.py: using BVCI 19262 05:30:41.160473 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 05:30:41.277213 tst assert_extension.py:10: start nitb and bts... 05:30:41.481071 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:30:42.101608 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29017): Launched 05:30:42.406774 run osmo-nitb_10.42.42.2(pid=29018): Launched 05:30:42.575342 run osmo-nitb_10.42.42.2(pid=29018): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29018)] 05:30:42.712103 run osmo-nitb_10.42.42.2(pid=29018): stdout: | (launched: 2022-12-09_05:30:42.349187) 05:30:42.850495 run osmo-nitb_10.42.42.2(pid=29018): stderr: | (launched: 2022-12-09_05:30:42.394254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:42.988742 run osmo-nitb_10.42.42.2(pid=29018): stdout: | (launched: 2022-12-09_05:30:42.349187) 05:30:43.121069 run osmo-nitb_10.42.42.2(pid=29018): stderr: | (launched: 2022-12-09_05:30:42.394254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29018) [trial-2355↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29018)] 05:30:43.521542 tst osmo-nitb_10.42.42.2(pid=29018): stdout: | (launched: 2022-12-09_05:30:42.349187) 05:30:43.644209 tst osmo-nitb_10.42.42.2(pid=29018): stderr: | (launched: 2022-12-09_05:30:42.394254) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:30:43.789702 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29018) [trial-2355↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29018)] [trial-2355↪nitb_ussd:sysmo↪assert_extension.py:12] 05:30:43.798185 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:30:43.804991 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29017): Terminating (SIGTERM) 05:30:44.016617 --- ParallelTerminationStrategy: PID 29017 died... 05:30:44.037387 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29017): Terminated: ok {rc=0} 05:30:44.125541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:sysmo --------------------------------------------------------------------- 05:30:45.296879 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:45.302047 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 05:30:45.323793 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 05:30:45.351267 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 05:30:45.386500 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 05:30:45.407207 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 05:30:45.434070 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 05:30:45.966995 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:sysmo assert_extension.py ---------------------------------------------- 05:30:45.974145 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:45.986037 tst ussd:sysmo: Using 1 x bts (candidates: 1) 05:30:46.023907 tst assert_extension.py: using LAC 19262 05:30:46.175463 tst assert_extension.py: using RAC 137 05:30:46.335853 tst assert_extension.py: using CellId 19262 05:30:46.500603 tst assert_extension.py: using BVCI 19263 05:30:46.654352 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:46.669403 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:46.683763 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:46.701119 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:46.716725 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 05:30:46.732542 tst ussd:sysmo: Using 1 x modem (candidates: 1) 05:30:46.876840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:47.429819 run create_hlr_db(pid=29022): Launched 05:30:47.555071 bus /sierra_2: Setting Powered False 05:30:48.615594 run create_hlr_db(pid=29022): Terminated: ok {rc=0} 05:30:49.064509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29024): Launched 05:30:49.393044 run osmo-hlr_10.42.42.2(pid=29025): Launched 05:30:49.516781 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:50.083779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29027): Launched 05:30:50.414207 run osmo-stp_10.42.42.5(pid=29028): Launched 05:30:50.537482 run osmo-msc_10.42.42.6: Starting osmo-msc 05:30:51.126040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29030): Launched 05:30:51.453933 run osmo-msc_10.42.42.6(pid=29031): Launched 05:30:51.635819 run osmo-stp_10.42.42.5(pid=29028): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29028)] 05:30:51.773075 run osmo-stp_10.42.42.5(pid=29028): stdout: | (launched: 2022-12-09_05:30:50.352763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:51.911462 run osmo-stp_10.42.42.5(pid=29028): stderr: | 20221209053050547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053050547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053050547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053050548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053050548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053050548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053050548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:52.048798 run osmo-stp_10.42.42.5(pid=29028): stdout: | (launched: 2022-12-09_05:30:50.352763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:30:52.179068 run osmo-stp_10.42.42.5(pid=29028): stderr: | 20221209053050547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053050547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053050547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053050548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053050548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053050548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053050548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:30:52.334294 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29028): Process ended prematurely: osmo-stp_10.42.42.5(pid=29028) [trial-2355↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29028)] [trial-2355↪ussd:sysmo↪assert_extension.py:17] 05:30:52.343180 tst assert_extension.py:17: Test FAILED (6.4 sec) 05:30:52.370565 run osmo-hlr_10.42.42.2(pid=29025): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29025)] 05:30:52.421632 run osmo-hlr_10.42.42.2(pid=29025): stdout: | (launched: 2022-12-09_05:30:49.331614) 05:30:52.474347 run osmo-hlr_10.42.42.2(pid=29025): stderr: | 20221209053049533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053049533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053049534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053049534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053049534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053049534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053049546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053049557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053049557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053049557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:30:52.547464 run osmo-msc_10.42.42.6(pid=29031): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29031)] 05:30:52.598623 run osmo-msc_10.42.42.6(pid=29031): stdout: | (launched: 2022-12-09_05:30:51.392272) 05:30:52.652030 run osmo-msc_10.42.42.6(pid=29031): stderr: | 20221209053051721 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053051721 DLGLOBAL DEBUG validating counter group 0x7fe439b14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053051721 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053051721 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053051722 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053051722 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053051723 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053051724 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053051724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053051724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:30:52.705542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29024): Terminating (SIGTERM) 05:30:52.748184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29027): Terminating (SIGTERM) 05:30:52.790672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29030): Terminating (SIGTERM) 05:30:52.833257 --- ParallelTerminationStrategy: PID 29024 died... 05:30:52.853575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29024): Terminated: ok {rc=0} 05:30:52.900783 --- ParallelTerminationStrategy: PID 29027 died... 05:30:52.920806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29027): Terminated: ok {rc=0} 05:30:52.967831 --- ParallelTerminationStrategy: PID 29030 died... 05:30:52.987634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29030): Terminated: ok {rc=0} 05:30:53.077101 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:30:54.276269 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:30:54.282841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:30:54.304435 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:30:54.331649 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:30:54.387652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:30:54.410265 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:30:54.438355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:30:54.983255 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:30:55.035507 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.046855 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:30:55.109997 tst mo_mt_call.py: using LAC 19263 05:30:55.236228 tst mo_mt_call.py: using RAC 138 05:30:55.367445 tst mo_mt_call.py: using CellId 19263 05:30:55.496104 tst mo_mt_call.py: using BVCI 19264 05:30:55.611068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.622634 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.633859 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.645401 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.656824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:30:55.668348 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:55.786244 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:30:55.908669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:30:56.391755 run create_hlr_db(pid=29036): Launched 05:30:56.511544 bus /sierra_2: Setting Powered False 05:30:57.572874 run create_hlr_db(pid=29036): Terminated: ok {rc=0} 05:30:58.029267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Launched 05:30:58.364609 run osmo-hlr_10.42.42.2(pid=29039): Launched 05:30:58.492341 run osmo-stp_10.42.42.5: Starting osmo-stp 05:30:59.068875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Launched 05:30:59.403578 run osmo-stp_10.42.42.5(pid=29042): Launched 05:30:59.530684 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:00.133373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29044): Launched 05:31:00.466824 run osmo-msc_10.42.42.6(pid=29045): Launched 05:31:00.651816 run osmo-stp_10.42.42.5(pid=29042): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] 05:31:00.792543 run osmo-stp_10.42.42.5(pid=29042): stdout: | (launched: 2022-12-09_05:30:59.341082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:00.995939 run osmo-stp_10.42.42.5(pid=29042): stderr: | 20221209053059539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053059539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053059539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053059540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053059540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053059540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053059540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:01.143729 run osmo-stp_10.42.42.5(pid=29042): stdout: | (launched: 2022-12-09_05:30:59.341082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:01.277572 run osmo-stp_10.42.42.5(pid=29042): stderr: | 20221209053059539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053059539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053059539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053059540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053059540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053059540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053059540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:01.439021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29042): Process ended prematurely: osmo-stp_10.42.42.5(pid=29042) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:31:01.449399 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:31:01.478138 run osmo-hlr_10.42.42.2(pid=29039): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29039)] 05:31:01.529632 run osmo-hlr_10.42.42.2(pid=29039): stdout: | (launched: 2022-12-09_05:30:58.302217) 05:31:01.583343 run osmo-hlr_10.42.42.2(pid=29039): stderr: | 20221209053058503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053058503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053058503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053058503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053058504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053058504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053058516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053058525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053058525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053058525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:01.658582 run osmo-msc_10.42.42.6(pid=29045): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29045)] 05:31:01.711157 run osmo-msc_10.42.42.6(pid=29045): stdout: | (launched: 2022-12-09_05:31:00.404149) 05:31:01.765187 run osmo-msc_10.42.42.6(pid=29045): stderr: | 20221209053100730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053100730 DLGLOBAL DEBUG validating counter group 0x7f068c25bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053100730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053100731 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053100731 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053100731 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053100733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053100733 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053100733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053100733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:01.846392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Terminating (SIGTERM) 05:31:01.906132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Terminating (SIGTERM) 05:31:01.951537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29044): Terminating (SIGTERM) 05:31:01.997382 --- ParallelTerminationStrategy: PID 29038 died... 05:31:02.017981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29038): Terminated: ok {rc=0} 05:31:02.067586 --- ParallelTerminationStrategy: PID 29041 died... 05:31:02.087838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29041): Terminated: ok {rc=0} 05:31:02.136261 --- ParallelTerminationStrategy: PID 29044 died... 05:31:02.156534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29044): Terminated: ok {rc=0} 05:31:02.247435 bus /sierra_3: Setting Powered False 05:31:03.348002 bus /sierra_3: Setting Powered False 05:31:04.468249 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:31:05.618414 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:05.630491 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:31:05.686165 tst mo_mt_call_osmux.py: using LAC 19264 05:31:05.808645 tst mo_mt_call_osmux.py: using RAC 139 05:31:05.932360 tst mo_mt_call_osmux.py: using CellId 19264 05:31:06.058915 tst mo_mt_call_osmux.py: using BVCI 19265 05:31:06.173170 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:06.184274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:06.195247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:06.206510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:06.217746 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:31:06.228835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:06.346657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:31:06.467841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:07.008558 run create_hlr_db(pid=29047): Launched 05:31:07.162810 bus /sierra_2: Setting Powered False 05:31:08.223930 run create_hlr_db(pid=29047): Terminated: ok {rc=0} 05:31:08.659584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Launched 05:31:08.974011 run osmo-hlr_10.42.42.2(pid=29050): Launched 05:31:09.092587 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:09.628407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Launched 05:31:09.942187 run osmo-stp_10.42.42.5(pid=29053): Launched 05:31:10.060494 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:10.623774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29055): Launched 05:31:10.938252 run osmo-msc_10.42.42.6(pid=29056): Launched 05:31:11.112227 run osmo-stp_10.42.42.5(pid=29053): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] 05:31:11.245111 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-09_05:31:09.882875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:11.376712 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221209053110058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053110058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053110059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053110059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053110060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053110060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053110060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:11.506667 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-09_05:31:09.882875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:11.630395 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221209053110058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053110058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053110059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053110059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053110060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053110060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053110060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:11.778574 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:31:11.787600 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:31:11.815003 run osmo-hlr_10.42.42.2(pid=29050): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29050)] 05:31:11.864357 run osmo-hlr_10.42.42.2(pid=29050): stdout: | (launched: 2022-12-09_05:31:08.914674) 05:31:11.915648 run osmo-hlr_10.42.42.2(pid=29050): stderr: | 20221209053109093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053109093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053109093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053109093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053109093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053109094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053109147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053109157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053109157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053109158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:11.986435 run osmo-msc_10.42.42.6(pid=29056): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29056)] 05:31:12.035468 run osmo-msc_10.42.42.6(pid=29056): stdout: | (launched: 2022-12-09_05:31:10.879140) 05:31:12.086488 run osmo-msc_10.42.42.6(pid=29056): stderr: | 20221209053111154 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053111154 DLGLOBAL DEBUG validating counter group 0x7f96107d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053111154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053111154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053111154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053111154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053111156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053111157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053111157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053111157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:12.137688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminating (SIGTERM) 05:31:12.178582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminating (SIGTERM) 05:31:12.219585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29055): Terminating (SIGTERM) 05:31:12.260709 --- ParallelTerminationStrategy: PID 29049 died... 05:31:12.280236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminated: ok {rc=0} 05:31:12.325910 --- ParallelTerminationStrategy: PID 29052 died... 05:31:12.344879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminated: ok {rc=0} 05:31:12.390430 --- ParallelTerminationStrategy: PID 29055 died... 05:31:12.409390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29055): Terminated: ok {rc=0} 05:31:12.496470 bus /sierra_3: Setting Powered False 05:31:13.596440 bus /sierra_3: Setting Powered False 05:31:14.711044 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:31:15.983354 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:15.992650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:31:16.016416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:31:16.045632 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:31:16.098010 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:31:16.120594 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:31:16.149753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:31:16.721876 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:31:16.776463 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:16.788620 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:31:16.847248 tst mo_mt_call.py: using LAC 19265 05:31:16.979632 tst mo_mt_call.py: using RAC 140 05:31:17.119442 tst mo_mt_call.py: using CellId 19265 05:31:17.244561 tst mo_mt_call.py: using BVCI 19266 05:31:17.359775 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:17.371109 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:17.382330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:17.393754 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:17.405405 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:17.417194 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:17.538224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:17.659678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:18.179218 run create_hlr_db(pid=29061): Launched 05:31:18.314650 bus /sierra_2: Setting Powered False 05:31:19.379883 run create_hlr_db(pid=29061): Terminated: ok {rc=0} 05:31:19.824620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29063): Launched 05:31:20.138894 run osmo-hlr_10.42.42.2(pid=29064): Launched 05:31:20.256847 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:20.809185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29066): Launched 05:31:21.122427 run osmo-stp_10.42.42.5(pid=29067): Launched 05:31:21.240925 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:21.819873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29069): Launched 05:31:22.134766 run osmo-msc_10.42.42.6(pid=29070): Launched 05:31:22.309363 run osmo-stp_10.42.42.5(pid=29067): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29067)] 05:31:22.442781 run osmo-stp_10.42.42.5(pid=29067): stdout: | (launched: 2022-12-09_05:31:21.063058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:22.574455 run osmo-stp_10.42.42.5(pid=29067): stderr: | 20221209053121238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053121238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053121238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053121239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053121239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053121239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053121239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:22.704189 run osmo-stp_10.42.42.5(pid=29067): stdout: | (launched: 2022-12-09_05:31:21.063058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:22.827680 run osmo-stp_10.42.42.5(pid=29067): stderr: | 20221209053121238 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053121238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053121238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053121239 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053121239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053121239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053121239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:22.975827 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29067): Process ended prematurely: osmo-stp_10.42.42.5(pid=29067) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29067)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:31:22.984734 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:31:23.011881 run osmo-hlr_10.42.42.2(pid=29064): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29064)] 05:31:23.060738 run osmo-hlr_10.42.42.2(pid=29064): stdout: | (launched: 2022-12-09_05:31:20.079389) 05:31:23.111199 run osmo-hlr_10.42.42.2(pid=29064): stderr: | 20221209053120263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053120263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053120263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053120263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053120263 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053120263 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053120275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053120286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053120286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053120286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:23.181668 run osmo-msc_10.42.42.6(pid=29070): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29070)] 05:31:23.230366 run osmo-msc_10.42.42.6(pid=29070): stdout: | (launched: 2022-12-09_05:31:22.075354) 05:31:23.280722 run osmo-msc_10.42.42.6(pid=29070): stderr: | 20221209053122352 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053122352 DLGLOBAL DEBUG validating counter group 0x7f2465e9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053122352 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053122352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053122352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053122352 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053122354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053122354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053122355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053122355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:23.331591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29063): Terminating (SIGTERM) 05:31:23.372259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29066): Terminating (SIGTERM) 05:31:23.412777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29069): Terminating (SIGTERM) 05:31:23.453540 --- ParallelTerminationStrategy: PID 29063 died... 05:31:23.472822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29063): Terminated: ok {rc=0} 05:31:23.517783 --- ParallelTerminationStrategy: PID 29066 died... 05:31:23.536610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29066): Terminated: ok {rc=0} 05:31:23.581646 --- ParallelTerminationStrategy: PID 29069 died... 05:31:23.600398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29069): Terminated: ok {rc=0} 05:31:23.685240 bus /sierra_3: Setting Powered False 05:31:24.781829 bus /sierra_3: Setting Powered False 05:31:25.898168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:31:27.049678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.062122 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:31:27.121236 tst mo_mt_call_osmux.py: using LAC 19266 05:31:27.253272 tst mo_mt_call_osmux.py: using RAC 141 05:31:27.387725 tst mo_mt_call_osmux.py: using CellId 19266 05:31:27.517531 tst mo_mt_call_osmux.py: using BVCI 19267 05:31:27.639335 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.651173 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.662839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.674320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.685925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:31:27.697585 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:27.817690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:31:27.937334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:28.457595 run create_hlr_db(pid=29072): Launched 05:31:28.592462 bus /sierra_2: Setting Powered False 05:31:29.657588 run create_hlr_db(pid=29072): Terminated: ok {rc=0} 05:31:30.123925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29074): Launched 05:31:30.461163 run osmo-hlr_10.42.42.2(pid=29075): Launched 05:31:30.588139 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:31.184687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29077): Launched 05:31:31.521144 run osmo-stp_10.42.42.5(pid=29078): Launched 05:31:31.739970 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:32.536444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29080): Launched 05:31:32.850108 run osmo-msc_10.42.42.6(pid=29081): Launched 05:31:33.024119 run osmo-stp_10.42.42.5(pid=29078): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29078)] 05:31:33.157230 run osmo-stp_10.42.42.5(pid=29078): stdout: | (launched: 2022-12-09_05:31:31.457048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:33.288621 run osmo-stp_10.42.42.5(pid=29078): stderr: | 20221209053131862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053131863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053131865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053131867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053131870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053131870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053131871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:33.418646 run osmo-stp_10.42.42.5(pid=29078): stdout: | (launched: 2022-12-09_05:31:31.457048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:33.541876 run osmo-stp_10.42.42.5(pid=29078): stderr: | 20221209053131862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053131863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053131865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053131867 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053131870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053131870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053131871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:33.689714 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29078): Process ended prematurely: osmo-stp_10.42.42.5(pid=29078) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29078)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:31:33.698691 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:31:33.725549 run osmo-hlr_10.42.42.2(pid=29075): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29075)] 05:31:33.774288 run osmo-hlr_10.42.42.2(pid=29075): stdout: | (launched: 2022-12-09_05:31:30.398894) 05:31:33.824473 run osmo-hlr_10.42.42.2(pid=29075): stderr: | 20221209053130604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053130604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053130604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053130604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053130604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053130604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053130619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053130629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053130629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053130629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:33.894257 run osmo-msc_10.42.42.6(pid=29081): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29081)] 05:31:33.942456 run osmo-msc_10.42.42.6(pid=29081): stdout: | (launched: 2022-12-09_05:31:32.790907) 05:31:33.992431 run osmo-msc_10.42.42.6(pid=29081): stderr: | 20221209053133067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053133067 DLGLOBAL DEBUG validating counter group 0x7f5c6e384c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053133067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053133067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053133067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053133067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053133069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053133070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053133070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053133070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:34.042631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29074): Terminating (SIGTERM) 05:31:34.082781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29077): Terminating (SIGTERM) 05:31:34.123400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29080): Terminating (SIGTERM) 05:31:34.163844 --- ParallelTerminationStrategy: PID 29074 died... 05:31:34.182912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29074): Terminated: ok {rc=0} 05:31:34.227939 --- ParallelTerminationStrategy: PID 29077 died... 05:31:34.246869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29077): Terminated: ok {rc=0} 05:31:34.291945 --- ParallelTerminationStrategy: PID 29080 died... 05:31:34.310957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29080): Terminated: ok {rc=0} 05:31:34.398967 bus /sierra_3: Setting Powered False 05:31:35.500428 bus /sierra_3: Setting Powered False 05:31:36.617949 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:31:37.859243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:37.866456 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:31:37.888219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:31:37.918843 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:31:37.974370 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:31:37.996246 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:31:38.023608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:31:38.574000 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:31:38.626747 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:38.638094 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:31:38.694453 tst mo_mt_call.py: using LAC 19267 05:31:38.831151 tst mo_mt_call.py: using RAC 142 05:31:38.962598 tst mo_mt_call.py: using CellId 19267 05:31:39.094382 tst mo_mt_call.py: using BVCI 19268 05:31:39.216158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:39.227918 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:39.239510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:39.250902 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:39.262288 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:39.273835 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:39.390597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:39.507793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:39.993615 run create_hlr_db(pid=29086): Launched 05:31:40.113134 bus /sierra_2: Setting Powered False 05:31:41.174907 run create_hlr_db(pid=29086): Terminated: ok {rc=0} 05:31:41.631998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Launched 05:31:41.968040 run osmo-hlr_10.42.42.2(pid=29089): Launched 05:31:42.096162 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:42.672626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Launched 05:31:43.007780 run osmo-stp_10.42.42.5(pid=29092): Launched 05:31:43.137509 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:43.740479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29094): Launched 05:31:44.075758 run osmo-msc_10.42.42.6(pid=29095): Launched 05:31:44.261969 run osmo-stp_10.42.42.5(pid=29092): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] 05:31:44.403506 run osmo-stp_10.42.42.5(pid=29092): stdout: | (launched: 2022-12-09_05:31:42.945030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:44.544290 run osmo-stp_10.42.42.5(pid=29092): stderr: | 20221209053143140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053143140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053143140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053143141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053143143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053143143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053143143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:44.683710 run osmo-stp_10.42.42.5(pid=29092): stdout: | (launched: 2022-12-09_05:31:42.945030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:44.815788 run osmo-stp_10.42.42.5(pid=29092): stderr: | 20221209053143140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053143140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053143140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053143141 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053143143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053143143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053143143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:44.973980 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29092): Process ended prematurely: osmo-stp_10.42.42.5(pid=29092) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:31:44.983555 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:31:45.011558 run osmo-hlr_10.42.42.2(pid=29089): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29089)] 05:31:45.063055 run osmo-hlr_10.42.42.2(pid=29089): stdout: | (launched: 2022-12-09_05:31:41.905474) 05:31:45.116210 run osmo-hlr_10.42.42.2(pid=29089): stderr: | 20221209053142108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053142108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053142108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053142109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053142109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053142109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053142121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053142131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053142131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053142131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:45.189402 run osmo-msc_10.42.42.6(pid=29095): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29095)] 05:31:45.240174 run osmo-msc_10.42.42.6(pid=29095): stdout: | (launched: 2022-12-09_05:31:44.012848) 05:31:45.292608 run osmo-msc_10.42.42.6(pid=29095): stderr: | 20221209053144341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053144341 DLGLOBAL DEBUG validating counter group 0x7f4f7cf75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053144341 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053144341 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053144342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053144342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053144344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053144344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053144344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053144344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:45.345565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Terminating (SIGTERM) 05:31:45.387736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Terminating (SIGTERM) 05:31:45.429881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29094): Terminating (SIGTERM) 05:31:45.472170 --- ParallelTerminationStrategy: PID 29088 died... 05:31:45.492368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Terminated: ok {rc=0} 05:31:45.539017 --- ParallelTerminationStrategy: PID 29091 died... 05:31:45.558850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Terminated: ok {rc=0} 05:31:45.605284 --- ParallelTerminationStrategy: PID 29094 died... 05:31:45.624929 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29094): Terminated: ok {rc=0} 05:31:45.714729 bus /sierra_3: Setting Powered False 05:31:46.814315 bus /sierra_3: Setting Powered False 05:31:47.930524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:31:49.083588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.096562 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:31:49.155295 tst mo_mt_call_osmux.py: using LAC 19268 05:31:49.287829 tst mo_mt_call_osmux.py: using RAC 143 05:31:49.412375 tst mo_mt_call_osmux.py: using CellId 19268 05:31:49.534762 tst mo_mt_call_osmux.py: using BVCI 19269 05:31:49.651382 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.662809 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.674490 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.686464 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.698175 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:31:49.710282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:49.834243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:31:49.952907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:31:50.441467 run create_hlr_db(pid=29097): Launched 05:31:50.560686 bus /sierra_2: Setting Powered False 05:31:51.621614 run create_hlr_db(pid=29097): Terminated: ok {rc=0} 05:31:52.079106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29099): Launched 05:31:52.416062 run osmo-hlr_10.42.42.2(pid=29100): Launched 05:31:52.543263 run osmo-stp_10.42.42.5: Starting osmo-stp 05:31:53.124710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29102): Launched 05:31:53.460183 run osmo-stp_10.42.42.5(pid=29103): Launched 05:31:53.587480 run osmo-msc_10.42.42.6: Starting osmo-msc 05:31:54.192082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29105): Launched 05:31:54.528738 run osmo-msc_10.42.42.6(pid=29106): Launched 05:31:54.714205 run osmo-stp_10.42.42.5(pid=29103): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29103)] 05:31:54.855598 run osmo-stp_10.42.42.5(pid=29103): stdout: | (launched: 2022-12-09_05:31:53.397607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:54.996708 run osmo-stp_10.42.42.5(pid=29103): stderr: | 20221209053153594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053153594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053153594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053153595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053153595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053153595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053153595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:55.138087 run osmo-stp_10.42.42.5(pid=29103): stdout: | (launched: 2022-12-09_05:31:53.397607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:31:55.271151 run osmo-stp_10.42.42.5(pid=29103): stderr: | 20221209053153594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053153594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053153594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053153595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053153595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053153595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053153595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:31:55.430063 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29103): Process ended prematurely: osmo-stp_10.42.42.5(pid=29103) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29103)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:31:55.439825 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:31:55.468315 run osmo-hlr_10.42.42.2(pid=29100): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29100)] 05:31:55.519885 run osmo-hlr_10.42.42.2(pid=29100): stdout: | (launched: 2022-12-09_05:31:52.353327) 05:31:55.573224 run osmo-hlr_10.42.42.2(pid=29100): stderr: | 20221209053152554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053152554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053152554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053152554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053152554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053152554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053152571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053152582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053152582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053152582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:31:55.647094 run osmo-msc_10.42.42.6(pid=29106): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29106)] 05:31:55.698538 run osmo-msc_10.42.42.6(pid=29106): stdout: | (launched: 2022-12-09_05:31:54.465648) 05:31:55.751418 run osmo-msc_10.42.42.6(pid=29106): stderr: | 20221209053154795 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053154795 DLGLOBAL DEBUG validating counter group 0x7fbefd35dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053154795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053154795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053154795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053154795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053154797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053154798 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053154798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053154798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:31:55.804353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29099): Terminating (SIGTERM) 05:31:55.847480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29102): Terminating (SIGTERM) 05:31:55.890457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29105): Terminating (SIGTERM) 05:31:55.933554 --- ParallelTerminationStrategy: PID 29099 died... 05:31:55.953956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29099): Terminated: ok {rc=0} 05:31:56.001551 --- ParallelTerminationStrategy: PID 29102 died... 05:31:56.021696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29102): Terminated: ok {rc=0} 05:31:56.068881 --- ParallelTerminationStrategy: PID 29105 died... 05:31:56.089575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29105): Terminated: ok {rc=0} 05:31:56.179631 bus /sierra_3: Setting Powered False 05:31:57.281468 bus /sierra_3: Setting Powered False 05:31:58.401579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:31:59.640663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:31:59.647154 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:31:59.668321 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:31:59.696881 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:31:59.749935 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:31:59.771083 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:31:59.797818 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:32:00.346856 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:32:00.396557 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:00.407658 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:32:00.464523 tst mo_mt_call.py: using LAC 19269 05:32:00.589187 tst mo_mt_call.py: using RAC 144 05:32:00.711644 tst mo_mt_call.py: using CellId 19269 05:32:00.837608 tst mo_mt_call.py: using BVCI 19270 05:32:00.969152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:00.981189 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:00.993146 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:01.006125 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:01.020389 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:01.033470 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:01.172332 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:01.318807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:01.856295 run create_hlr_db(pid=29113): Launched 05:32:02.027402 bus /sierra_2: Setting Powered False 05:32:03.092786 run create_hlr_db(pid=29113): Terminated: ok {rc=0} 05:32:03.539909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29115): Launched 05:32:03.876697 run osmo-hlr_10.42.42.2(pid=29116): Launched 05:32:04.003228 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:04.583010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29118): Launched 05:32:04.917843 run osmo-stp_10.42.42.5(pid=29119): Launched 05:32:05.044726 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:05.649451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29121): Launched 05:32:05.985307 run osmo-msc_10.42.42.6(pid=29122): Launched 05:32:06.171684 run osmo-stp_10.42.42.5(pid=29119): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29119)] 05:32:06.312393 run osmo-stp_10.42.42.5(pid=29119): stdout: | (launched: 2022-12-09_05:32:04.855350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:06.452766 run osmo-stp_10.42.42.5(pid=29119): stderr: | 20221209053205052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053205052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053205053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053205053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053205054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053205054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053205054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:06.591675 run osmo-stp_10.42.42.5(pid=29119): stdout: | (launched: 2022-12-09_05:32:04.855350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:06.723622 run osmo-stp_10.42.42.5(pid=29119): stderr: | 20221209053205052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053205052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053205053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053205053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053205054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053205054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053205054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:06.881710 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29119): Process ended prematurely: osmo-stp_10.42.42.5(pid=29119) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29119)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:32:06.891269 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:32:06.919037 run osmo-hlr_10.42.42.2(pid=29116): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29116)] 05:32:06.969305 run osmo-hlr_10.42.42.2(pid=29116): stdout: | (launched: 2022-12-09_05:32:03.814287) 05:32:07.021623 run osmo-hlr_10.42.42.2(pid=29116): stderr: | 20221209053204019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053204019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053204019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053204019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053204019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053204019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053204033 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053204042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053204043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053204043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:07.094409 run osmo-msc_10.42.42.6(pid=29122): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29122)] 05:32:07.145084 run osmo-msc_10.42.42.6(pid=29122): stdout: | (launched: 2022-12-09_05:32:05.922619) 05:32:07.197196 run osmo-msc_10.42.42.6(pid=29122): stderr: | 20221209053206252 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053206252 DLGLOBAL DEBUG validating counter group 0x7f308478ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053206252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053206252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053206252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053206253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053206254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053206255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053206255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053206255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:07.250191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29115): Terminating (SIGTERM) 05:32:07.292390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29118): Terminating (SIGTERM) 05:32:07.335219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29121): Terminating (SIGTERM) 05:32:07.378272 --- ParallelTerminationStrategy: PID 29115 died... 05:32:07.398353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29115): Terminated: ok {rc=0} 05:32:07.444917 --- ParallelTerminationStrategy: PID 29118 died... 05:32:07.464662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29118): Terminated: ok {rc=0} 05:32:07.511370 --- ParallelTerminationStrategy: PID 29121 died... 05:32:07.531132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29121): Terminated: ok {rc=0} 05:32:07.619275 bus /sierra_3: Setting Powered False 05:32:08.719622 bus /sierra_3: Setting Powered False 05:32:09.836675 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:32:10.985556 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:10.997590 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:32:11.054015 tst mo_mt_call_osmux.py: using LAC 19270 05:32:11.178587 tst mo_mt_call_osmux.py: using RAC 145 05:32:11.302890 tst mo_mt_call_osmux.py: using CellId 19270 05:32:11.431473 tst mo_mt_call_osmux.py: using BVCI 19271 05:32:11.546534 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:11.557639 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:11.569161 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:11.580646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:11.591958 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:32:11.603313 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:11.724315 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:32:11.843128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:12.328319 run create_hlr_db(pid=29124): Launched 05:32:12.447127 bus /sierra_2: Setting Powered False 05:32:13.508872 run create_hlr_db(pid=29124): Terminated: ok {rc=0} 05:32:13.944705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29126): Launched 05:32:14.258976 run osmo-hlr_10.42.42.2(pid=29127): Launched 05:32:14.378034 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:14.928641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29129): Launched 05:32:15.242020 run osmo-stp_10.42.42.5(pid=29130): Launched 05:32:15.361683 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:15.965305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29132): Launched 05:32:16.321838 run osmo-msc_10.42.42.6(pid=29133): Launched 05:32:16.779487 run osmo-stp_10.42.42.5(pid=29130): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29130)] 05:32:17.076846 run osmo-stp_10.42.42.5(pid=29130): stdout: | (launched: 2022-12-09_05:32:15.183149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:17.236347 run osmo-stp_10.42.42.5(pid=29130): stderr: | 20221209053215359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053215359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053215359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053215360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053215360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053215360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053215360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:17.368643 run osmo-stp_10.42.42.5(pid=29130): stdout: | (launched: 2022-12-09_05:32:15.183149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:17.492099 run osmo-stp_10.42.42.5(pid=29130): stderr: | 20221209053215359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053215359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053215359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053215360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053215360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053215360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053215360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:17.639867 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29130): Process ended prematurely: osmo-stp_10.42.42.5(pid=29130) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29130)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:32:17.649225 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:32:17.676701 run osmo-hlr_10.42.42.2(pid=29127): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29127)] 05:32:17.725613 run osmo-hlr_10.42.42.2(pid=29127): stdout: | (launched: 2022-12-09_05:32:14.199482) 05:32:17.776579 run osmo-hlr_10.42.42.2(pid=29127): stderr: | 20221209053214379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053214379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053214379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053214379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053214379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053214379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053214390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053214398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053214398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053214399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:17.847172 run osmo-msc_10.42.42.6(pid=29133): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29133)] 05:32:17.896095 run osmo-msc_10.42.42.6(pid=29133): stdout: | (launched: 2022-12-09_05:32:16.255457) 05:32:17.946473 run osmo-msc_10.42.42.6(pid=29133): stderr: | 20221209053216690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053216690 DLGLOBAL DEBUG validating counter group 0x7f1db7bb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053216691 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053216691 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053216691 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053216691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053216693 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053216693 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053216693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053216693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:17.997304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29126): Terminating (SIGTERM) 05:32:18.037779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29129): Terminating (SIGTERM) 05:32:18.078547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29132): Terminating (SIGTERM) 05:32:18.119618 --- ParallelTerminationStrategy: PID 29126 died... 05:32:18.139030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29126): Terminated: ok {rc=0} 05:32:18.184219 --- ParallelTerminationStrategy: PID 29129 died... 05:32:18.203120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29129): Terminated: ok {rc=0} 05:32:18.248443 --- ParallelTerminationStrategy: PID 29132 died... 05:32:18.267487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29132): Terminated: ok {rc=0} 05:32:18.355805 bus /sierra_3: Setting Powered False 05:32:19.457869 bus /sierra_3: Setting Powered False 05:32:20.575902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:32:21.814516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:21.821024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:32:21.842649 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:32:21.869696 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:32:21.923289 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:32:21.945148 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:32:21.972263 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:32:22.522293 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:32:22.573121 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:22.584381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:22.640887 tst mo_mt_call.py: using LAC 19271 05:32:22.762833 tst mo_mt_call.py: using RAC 146 05:32:22.886291 tst mo_mt_call.py: using CellId 19271 05:32:23.011164 tst mo_mt_call.py: using BVCI 19272 05:32:23.126940 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:23.138321 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:23.149421 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:23.160757 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:23.171992 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:23.183339 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:23.304055 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:23.426848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:23.913615 run create_hlr_db(pid=29138): Launched 05:32:24.032770 bus /sierra_2: Setting Powered False 05:32:25.095079 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 05:32:25.532218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 05:32:25.847306 run osmo-hlr_10.42.42.2(pid=29141): Launched 05:32:25.966487 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:26.518190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 05:32:26.832685 run osmo-stp_10.42.42.5(pid=29144): Launched 05:32:26.952588 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:27.519350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29146): Launched 05:32:27.834526 run osmo-msc_10.42.42.6(pid=29147): Launched 05:32:28.008736 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 05:32:28.142161 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-09_05:32:26.773501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:28.274488 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221209053226948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053226948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053226948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053226948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053226949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053226949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053226949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:28.404406 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-09_05:32:26.773501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:28.528053 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221209053226948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053226948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053226948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053226948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053226949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053226949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053226949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:28.676423 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:32:28.685508 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:32:28.712642 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 05:32:28.761707 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-09_05:32:25.787746) 05:32:28.812656 run osmo-hlr_10.42.42.2(pid=29141): stderr: | 20221209053225968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053225968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053225968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053225968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053225968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053225968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053225980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053225988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053225989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053225989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:28.883328 run osmo-msc_10.42.42.6(pid=29147): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29147)] 05:32:28.932442 run osmo-msc_10.42.42.6(pid=29147): stdout: | (launched: 2022-12-09_05:32:27.775459) 05:32:28.983343 run osmo-msc_10.42.42.6(pid=29147): stderr: | 20221209053228051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053228052 DLGLOBAL DEBUG validating counter group 0x7f966663bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053228052 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053228052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053228052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053228052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053228054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053228054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053228054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053228054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:29.034839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 05:32:29.076032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 05:32:29.117217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29146): Terminating (SIGTERM) 05:32:29.159107 --- ParallelTerminationStrategy: PID 29140 died... 05:32:29.178628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 05:32:29.224364 --- ParallelTerminationStrategy: PID 29143 died... 05:32:29.243709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 05:32:29.289204 --- ParallelTerminationStrategy: PID 29146 died... 05:32:29.308697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29146): Terminated: ok {rc=0} 05:32:29.394781 bus /sierra_3: Setting Powered False 05:32:30.494465 bus /sierra_3: Setting Powered False 05:32:31.622943 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:32:32.777259 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:32.789539 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:32:32.847734 tst mo_mt_call_osmux.py: using LAC 19272 05:32:32.980614 tst mo_mt_call_osmux.py: using RAC 147 05:32:33.110870 tst mo_mt_call_osmux.py: using CellId 19272 05:32:33.233385 tst mo_mt_call_osmux.py: using BVCI 19273 05:32:33.349200 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:33.360422 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:33.371613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:33.382934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:33.394266 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:32:33.406076 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:33.527744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:32:33.651408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:34.136314 run create_hlr_db(pid=29149): Launched 05:32:34.254981 bus /sierra_2: Setting Powered False 05:32:35.316171 run create_hlr_db(pid=29149): Terminated: ok {rc=0} 05:32:35.772519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Launched 05:32:36.107904 run osmo-hlr_10.42.42.2(pid=29152): Launched 05:32:36.235099 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:36.813575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Launched 05:32:37.148480 run osmo-stp_10.42.42.5(pid=29155): Launched 05:32:37.275423 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:37.881011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29157): Launched 05:32:38.217431 run osmo-msc_10.42.42.6(pid=29158): Launched 05:32:38.403026 run osmo-stp_10.42.42.5(pid=29155): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] 05:32:38.543712 run osmo-stp_10.42.42.5(pid=29155): stdout: | (launched: 2022-12-09_05:32:37.085518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:38.684789 run osmo-stp_10.42.42.5(pid=29155): stderr: | 20221209053237282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053237282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053237282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053237283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053237283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053237283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053237283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:38.824049 run osmo-stp_10.42.42.5(pid=29155): stdout: | (launched: 2022-12-09_05:32:37.085518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:38.957217 run osmo-stp_10.42.42.5(pid=29155): stderr: | 20221209053237282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053237282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053237282 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053237283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053237283 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053237283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053237283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:39.116116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29155): Process ended prematurely: osmo-stp_10.42.42.5(pid=29155) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:32:39.126031 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:32:39.153906 run osmo-hlr_10.42.42.2(pid=29152): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29152)] 05:32:39.204777 run osmo-hlr_10.42.42.2(pid=29152): stdout: | (launched: 2022-12-09_05:32:36.045763) 05:32:39.256726 run osmo-hlr_10.42.42.2(pid=29152): stderr: | 20221209053236248 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053236248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053236248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053236248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053236248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053236248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053236261 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053236269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053236270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053236270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:39.329054 run osmo-msc_10.42.42.6(pid=29158): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29158)] 05:32:39.381456 run osmo-msc_10.42.42.6(pid=29158): stdout: | (launched: 2022-12-09_05:32:38.154662) 05:32:39.444149 run osmo-msc_10.42.42.6(pid=29158): stderr: | 20221209053238482 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053238483 DLGLOBAL DEBUG validating counter group 0x7f6b3596ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053238483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053238483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053238483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053238483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053238485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053238485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053238485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053238486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:39.497178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Terminating (SIGTERM) 05:32:39.539255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Terminating (SIGTERM) 05:32:39.581520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29157): Terminating (SIGTERM) 05:32:39.623877 --- ParallelTerminationStrategy: PID 29151 died... 05:32:39.644079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29151): Terminated: ok {rc=0} 05:32:39.690871 --- ParallelTerminationStrategy: PID 29154 died... 05:32:39.710743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29154): Terminated: ok {rc=0} 05:32:39.757333 --- ParallelTerminationStrategy: PID 29157 died... 05:32:39.777131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29157): Terminated: ok {rc=0} 05:32:39.866220 bus /sierra_3: Setting Powered False 05:32:40.966458 bus /sierra_3: Setting Powered False 05:32:42.083462 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:32:43.316105 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:32:43.322453 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:32:43.343271 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:32:43.370973 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:32:43.424016 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:32:43.445063 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:32:43.471980 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:32:44.021810 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:32:44.071747 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.082909 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:32:44.139087 tst mo_mt_call.py: using LAC 19273 05:32:44.262542 tst mo_mt_call.py: using RAC 148 05:32:44.386118 tst mo_mt_call.py: using CellId 19273 05:32:44.513856 tst mo_mt_call.py: using BVCI 19274 05:32:44.628472 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.639675 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.650656 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.661858 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.673622 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:44.684809 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:44.804133 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:44.923330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:45.410183 run create_hlr_db(pid=29164): Launched 05:32:45.530413 bus /sierra_2: Setting Powered False 05:32:46.608938 run create_hlr_db(pid=29164): Terminated: ok {rc=0} 05:32:47.150695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29166): Launched 05:32:47.498117 run osmo-hlr_10.42.42.2(pid=29167): Launched 05:32:47.626251 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:48.206131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29169): Launched 05:32:48.542754 run osmo-stp_10.42.42.5(pid=29170): Launched 05:32:48.670811 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:49.276682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29172): Launched 05:32:49.613865 run osmo-msc_10.42.42.6(pid=29173): Launched 05:32:49.799172 run osmo-stp_10.42.42.5(pid=29170): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29170)] 05:32:49.940603 run osmo-stp_10.42.42.5(pid=29170): stdout: | (launched: 2022-12-09_05:32:48.479961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:50.081828 run osmo-stp_10.42.42.5(pid=29170): stderr: | 20221209053248674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053248674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053248675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053248675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053248676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053248676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053248676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:50.222010 run osmo-stp_10.42.42.5(pid=29170): stdout: | (launched: 2022-12-09_05:32:48.479961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:32:50.354643 run osmo-stp_10.42.42.5(pid=29170): stderr: | 20221209053248674 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053248674 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053248675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053248675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053248676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053248676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053248676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:32:50.513267 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29170): Process ended prematurely: osmo-stp_10.42.42.5(pid=29170) [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29170)] [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:32:50.522805 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:32:50.550680 run osmo-hlr_10.42.42.2(pid=29167): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29167)] 05:32:50.601817 run osmo-hlr_10.42.42.2(pid=29167): stdout: | (launched: 2022-12-09_05:32:47.435396) 05:32:50.654508 run osmo-hlr_10.42.42.2(pid=29167): stderr: | 20221209053247639 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053247640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053247640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053247640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053247640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053247640 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053247653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053247661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053247661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053247661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:32:50.727611 run osmo-msc_10.42.42.6(pid=29173): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29173)] 05:32:50.778064 run osmo-msc_10.42.42.6(pid=29173): stdout: | (launched: 2022-12-09_05:32:49.550109) 05:32:50.830331 run osmo-msc_10.42.42.6(pid=29173): stderr: | 20221209053249878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053249878 DLGLOBAL DEBUG validating counter group 0x7fbf1939ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053249878 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053249878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053249878 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053249879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053249880 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053249881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053249881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053249881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:32:50.882945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29166): Terminating (SIGTERM) 05:32:50.925156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29169): Terminating (SIGTERM) 05:32:50.967522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29172): Terminating (SIGTERM) 05:32:51.009991 --- ParallelTerminationStrategy: PID 29166 died... 05:32:51.030097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29166): Terminated: ok {rc=0} 05:32:51.076591 --- ParallelTerminationStrategy: PID 29169 died... 05:32:51.096343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29169): Terminated: ok {rc=0} 05:32:51.143070 --- ParallelTerminationStrategy: PID 29172 died... 05:32:51.162683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29172): Terminated: ok {rc=0} 05:32:51.251429 bus /sierra_3: Setting Powered False 05:32:52.352567 bus /sierra_3: Setting Powered False 05:32:53.471278 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:32:54.616478 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:54.628373 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:32:54.685560 tst mo_mt_call_osmux.py: using LAC 19274 05:32:54.815799 tst mo_mt_call_osmux.py: using RAC 149 05:32:54.946602 tst mo_mt_call_osmux.py: using CellId 19274 05:32:55.075496 tst mo_mt_call_osmux.py: using BVCI 19275 05:32:55.191606 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:55.203004 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:55.214549 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:55.225991 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:55.237626 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:32:55.249098 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:55.366165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:32:55.489236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:32:56.010368 run create_hlr_db(pid=29175): Launched 05:32:56.146486 bus /sierra_2: Setting Powered False 05:32:57.213148 run create_hlr_db(pid=29175): Terminated: ok {rc=0} 05:32:57.662162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Launched 05:32:57.976261 run osmo-hlr_10.42.42.2(pid=29178): Launched 05:32:58.094906 run osmo-stp_10.42.42.5: Starting osmo-stp 05:32:58.646984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Launched 05:32:58.961318 run osmo-stp_10.42.42.5(pid=29181): Launched 05:32:59.080079 run osmo-msc_10.42.42.6: Starting osmo-msc 05:32:59.644787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Launched 05:32:59.957452 run osmo-msc_10.42.42.6(pid=29184): Launched 05:33:00.132200 run osmo-stp_10.42.42.5(pid=29181): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] 05:33:00.265778 run osmo-stp_10.42.42.5(pid=29181): stdout: | (launched: 2022-12-09_05:32:58.901810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:00.397149 run osmo-stp_10.42.42.5(pid=29181): stderr: | 20221209053259075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053259075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053259076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053259076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053259078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053259078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053259079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:00.527192 run osmo-stp_10.42.42.5(pid=29181): stdout: | (launched: 2022-12-09_05:32:58.901810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:00.650589 run osmo-stp_10.42.42.5(pid=29181): stderr: | 20221209053259075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053259075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053259076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053259076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053259078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053259078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053259079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:00.798666 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29181): Process ended prematurely: osmo-stp_10.42.42.5(pid=29181) [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:33:00.807569 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:33:00.842970 run osmo-hlr_10.42.42.2(pid=29178): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29178)] 05:33:00.904611 run osmo-hlr_10.42.42.2(pid=29178): stdout: | (launched: 2022-12-09_05:32:57.917379) 05:33:00.957972 run osmo-hlr_10.42.42.2(pid=29178): stderr: | 20221209053258099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053258099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053258099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053258099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053258099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053258099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053258111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053258120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053258120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053258121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:01.032227 run osmo-msc_10.42.42.6(pid=29184): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29184)] 05:33:01.084747 run osmo-msc_10.42.42.6(pid=29184): stdout: | (launched: 2022-12-09_05:32:59.898531) 05:33:01.163363 run osmo-msc_10.42.42.6(pid=29184): stderr: | 20221209053300174 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053300175 DLGLOBAL DEBUG validating counter group 0x7f6159cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053300175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053300175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053300175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053300175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053300177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053300178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053300178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053300178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:01.216697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Terminating (SIGTERM) 05:33:01.260448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Terminating (SIGTERM) 05:33:01.305142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Terminating (SIGTERM) 05:33:01.348296 --- ParallelTerminationStrategy: PID 29177 died... 05:33:01.368496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29177): Terminated: ok {rc=0} 05:33:01.416916 --- ParallelTerminationStrategy: PID 29180 died... 05:33:01.436916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29180): Terminated: ok {rc=0} 05:33:01.485182 --- ParallelTerminationStrategy: PID 29183 died... 05:33:01.505158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29183): Terminated: ok {rc=0} 05:33:01.599018 bus /sierra_3: Setting Powered False 05:33:02.707786 bus /sierra_3: Setting Powered False 05:33:03.823823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:33:05.057297 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:05.062852 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:33:05.083494 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:33:05.111417 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:33:05.163527 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:33:05.184163 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:33:05.210769 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:33:05.760320 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:33:05.810522 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:05.821485 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:33:05.877739 tst mo_mt_call.py: using LAC 19275 05:33:06.002281 tst mo_mt_call.py: using RAC 150 05:33:06.127164 tst mo_mt_call.py: using CellId 19275 05:33:06.250026 tst mo_mt_call.py: using BVCI 19276 05:33:06.364696 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:06.375738 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:06.386483 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:06.397543 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:06.408415 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:06.419440 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:06.537499 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:06.662513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:07.148741 run create_hlr_db(pid=29190): Launched 05:33:07.266816 bus /sierra_2: Setting Powered False 05:33:08.328449 run create_hlr_db(pid=29190): Terminated: ok {rc=0} 05:33:08.784906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Launched 05:33:09.120496 run osmo-hlr_10.42.42.2(pid=29193): Launched 05:33:09.247881 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:09.824645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Launched 05:33:10.161336 run osmo-stp_10.42.42.5(pid=29196): Launched 05:33:10.289041 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:10.895813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Launched 05:33:11.231505 run osmo-msc_10.42.42.6(pid=29199): Launched 05:33:11.416209 run osmo-stp_10.42.42.5(pid=29196): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29196)] 05:33:11.557141 run osmo-stp_10.42.42.5(pid=29196): stdout: | (launched: 2022-12-09_05:33:10.098055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:11.697922 run osmo-stp_10.42.42.5(pid=29196): stderr: | 20221209053310295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053310295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053310295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053310296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053310296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053310296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053310296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:11.837666 run osmo-stp_10.42.42.5(pid=29196): stdout: | (launched: 2022-12-09_05:33:10.098055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:11.969817 run osmo-stp_10.42.42.5(pid=29196): stderr: | 20221209053310295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053310295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053310295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053310296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053310296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053310296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053310296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:12.127978 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29196): Process ended prematurely: osmo-stp_10.42.42.5(pid=29196) [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29196)] [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:33:12.137813 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:33:12.165544 run osmo-hlr_10.42.42.2(pid=29193): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29193)] 05:33:12.216237 run osmo-hlr_10.42.42.2(pid=29193): stdout: | (launched: 2022-12-09_05:33:09.058019) 05:33:12.268673 run osmo-hlr_10.42.42.2(pid=29193): stderr: | 20221209053309259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053309259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053309259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053309259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053309259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053309259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053309294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053309306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053309306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053309306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:12.341645 run osmo-msc_10.42.42.6(pid=29199): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29199)] 05:33:12.391964 run osmo-msc_10.42.42.6(pid=29199): stdout: | (launched: 2022-12-09_05:33:11.168613) 05:33:12.443799 run osmo-msc_10.42.42.6(pid=29199): stderr: | 20221209053311498 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053311498 DLGLOBAL DEBUG validating counter group 0x7faa36c7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053311498 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053311498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053311499 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053311499 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053311500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053311501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053311501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053311501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:12.495887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Terminating (SIGTERM) 05:33:12.537972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Terminating (SIGTERM) 05:33:12.580183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Terminating (SIGTERM) 05:33:12.622724 --- ParallelTerminationStrategy: PID 29192 died... 05:33:12.642865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29192): Terminated: ok {rc=0} 05:33:12.689338 --- ParallelTerminationStrategy: PID 29195 died... 05:33:12.709087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29195): Terminated: ok {rc=0} 05:33:12.755262 --- ParallelTerminationStrategy: PID 29198 died... 05:33:12.774940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29198): Terminated: ok {rc=0} 05:33:12.862915 bus /sierra_3: Setting Powered False 05:33:13.964274 bus /sierra_3: Setting Powered False 05:33:15.082169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:33:16.229135 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.241780 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:33:16.301242 tst mo_mt_call_osmux.py: using LAC 19276 05:33:16.468386 tst mo_mt_call_osmux.py: using RAC 151 05:33:16.599232 tst mo_mt_call_osmux.py: using CellId 19276 05:33:16.748232 tst mo_mt_call_osmux.py: using BVCI 19277 05:33:16.904486 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.919661 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.936140 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.951054 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.966110 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:33:16.982004 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:17.131092 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:33:17.260612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:17.784026 run create_hlr_db(pid=29201): Launched 05:33:17.920431 bus /sierra_2: Setting Powered False 05:33:18.986246 run create_hlr_db(pid=29201): Terminated: ok {rc=0} 05:33:19.430701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29203): Launched 05:33:19.743846 run osmo-hlr_10.42.42.2(pid=29204): Launched 05:33:19.863154 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:20.399336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29206): Launched 05:33:20.713623 run osmo-stp_10.42.42.5(pid=29207): Launched 05:33:20.833324 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:21.396911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29209): Launched 05:33:21.708904 run osmo-msc_10.42.42.6(pid=29210): Launched 05:33:21.883911 run osmo-stp_10.42.42.5(pid=29207): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29207)] 05:33:22.019190 run osmo-stp_10.42.42.5(pid=29207): stdout: | (launched: 2022-12-09_05:33:20.654633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:22.150520 run osmo-stp_10.42.42.5(pid=29207): stderr: | 20221209053320829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053320829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053320830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053320830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053320830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053320830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053320831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:22.280363 run osmo-stp_10.42.42.5(pid=29207): stdout: | (launched: 2022-12-09_05:33:20.654633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:22.403594 run osmo-stp_10.42.42.5(pid=29207): stderr: | 20221209053320829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053320829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053320830 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053320830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053320830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053320830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053320831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:22.551131 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29207): Process ended prematurely: osmo-stp_10.42.42.5(pid=29207) [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29207)] [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:33:22.560177 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:33:22.587197 run osmo-hlr_10.42.42.2(pid=29204): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29204)] 05:33:22.636153 run osmo-hlr_10.42.42.2(pid=29204): stdout: | (launched: 2022-12-09_05:33:19.684568) 05:33:22.686532 run osmo-hlr_10.42.42.2(pid=29204): stderr: | 20221209053319863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053319863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053319863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053319863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053319863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053319863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053319889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053319900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053319900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053319900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:22.756301 run osmo-msc_10.42.42.6(pid=29210): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29210)] 05:33:22.805189 run osmo-msc_10.42.42.6(pid=29210): stdout: | (launched: 2022-12-09_05:33:21.650395) 05:33:22.854972 run osmo-msc_10.42.42.6(pid=29210): stderr: | 20221209053321923 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053321923 DLGLOBAL DEBUG validating counter group 0x7f94a0959c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053321923 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053321924 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053321924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053321924 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053321926 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053321926 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053321926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053321926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:22.905419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29203): Terminating (SIGTERM) 05:33:22.945700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29206): Terminating (SIGTERM) 05:33:22.986044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29209): Terminating (SIGTERM) 05:33:23.026658 --- ParallelTerminationStrategy: PID 29203 died... 05:33:23.045904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29203): Terminated: ok {rc=0} 05:33:23.090790 --- ParallelTerminationStrategy: PID 29206 died... 05:33:23.109489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29206): Terminated: ok {rc=0} 05:33:23.154577 --- ParallelTerminationStrategy: PID 29209 died... 05:33:23.173472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29209): Terminated: ok {rc=0} 05:33:23.260795 bus /sierra_3: Setting Powered False 05:33:24.362128 bus /sierra_3: Setting Powered False 05:33:25.478882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:sysmo --------------------------------------------------------------------- 05:33:26.718588 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:26.723265 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 05:33:26.745453 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 05:33:26.773609 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 05:33:26.860679 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 05:33:26.882461 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 05:33:26.910349 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 05:33:27.495928 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 05:33:27.501611 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:27.512650 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:33:27.550337 tst emergency_mo_mt_call.py: using LAC 19277 05:33:27.681140 tst emergency_mo_mt_call.py: using RAC 152 05:33:27.809455 tst emergency_mo_mt_call.py: using CellId 19277 05:33:27.939919 tst emergency_mo_mt_call.py: using BVCI 19278 05:33:28.059375 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:28.070585 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:28.081675 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:28.092740 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:28.103908 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:28.115111 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:28.232198 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:28.352657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:28.865819 run create_hlr_db(pid=29215): Launched 05:33:28.998993 bus /sierra_2: Setting Powered False 05:33:30.063777 run create_hlr_db(pid=29215): Terminated: ok {rc=0} 05:33:30.506740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Launched 05:33:30.815256 run osmo-hlr_10.42.42.2(pid=29218): Launched 05:33:31.045233 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:31.668051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Launched 05:33:31.998874 run osmo-stp_10.42.42.5(pid=29221): Launched 05:33:32.220366 tst emergency_mo_mt_call.py: using MSISDN 7047 05:33:32.471974 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:33.024495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29223): Launched 05:33:33.332487 run osmo-msc_10.42.42.6(pid=29224): Launched 05:33:33.503986 run osmo-stp_10.42.42.5(pid=29221): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] 05:33:33.633833 run osmo-stp_10.42.42.5(pid=29221): stdout: | (launched: 2022-12-09_05:33:31.936747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:33.763889 run osmo-stp_10.42.42.5(pid=29221): stderr: | 20221209053332251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053332252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053332252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053332255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053332260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053332260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053332260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:33.891874 run osmo-stp_10.42.42.5(pid=29221): stdout: | (launched: 2022-12-09_05:33:31.936747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:34.014399 run osmo-stp_10.42.42.5(pid=29221): stderr: | 20221209053332251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053332252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053332252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053332255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053332260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053332260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053332260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:34.160186 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29221): Process ended prematurely: osmo-stp_10.42.42.5(pid=29221) [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py:19] 05:33:34.168453 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 05:33:34.195009 run osmo-hlr_10.42.42.2(pid=29218): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29218)] 05:33:34.244091 run osmo-hlr_10.42.42.2(pid=29218): stdout: | (launched: 2022-12-09_05:33:30.757107) 05:33:34.294707 run osmo-hlr_10.42.42.2(pid=29218): stderr: | 20221209053330952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053330952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053330952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053330952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053330952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053330952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053330971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053330990 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053330990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053330990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:34.365359 run osmo-msc_10.42.42.6(pid=29224): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29224)] 05:33:34.414408 run osmo-msc_10.42.42.6(pid=29224): stdout: | (launched: 2022-12-09_05:33:33.274331) 05:33:34.464898 run osmo-msc_10.42.42.6(pid=29224): stderr: | 20221209053333547 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053333547 DLGLOBAL DEBUG validating counter group 0x7fa8bb7cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053333547 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053333547 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053333547 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053333548 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053333549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053333550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053333550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053333550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:34.515869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Terminating (SIGTERM) 05:33:34.556635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Terminating (SIGTERM) 05:33:34.597453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29223): Terminating (SIGTERM) 05:33:34.638327 --- ParallelTerminationStrategy: PID 29217 died... 05:33:34.657718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29217): Terminated: ok {rc=0} 05:33:34.702921 --- ParallelTerminationStrategy: PID 29220 died... 05:33:34.721735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29220): Terminated: ok {rc=0} 05:33:34.766881 --- ParallelTerminationStrategy: PID 29223 died... 05:33:34.785671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29223): Terminated: ok {rc=0} 05:33:34.873227 bus /sierra_3: Setting Powered False 05:33:35.974562 bus /sierra_3: Setting Powered False 05:33:37.091656 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 05:33:38.179675 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.191126 tst emergency:sysmo: Using 1 x bts (candidates: 1) 05:33:38.229287 tst emergency_preemptive_call.py: using LAC 19278 05:33:38.352627 tst emergency_preemptive_call.py: using RAC 153 05:33:38.473081 tst emergency_preemptive_call.py: using CellId 19278 05:33:38.594147 tst emergency_preemptive_call.py: using BVCI 19279 05:33:38.706342 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.717062 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.727640 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.738413 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.749118 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 05:33:38.759858 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:38.878710 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:38.996079 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:39.113177 tst emergency:sysmo: Using 1 x modem (candidates: 4) 05:33:39.228126 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:39.706883 run create_hlr_db(pid=29226): Launched 05:33:39.823457 bus /sierra_2: Setting Powered False 05:33:40.884280 run create_hlr_db(pid=29226): Terminated: ok {rc=0} 05:33:41.336388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29228): Launched 05:33:41.668670 run osmo-hlr_10.42.42.2(pid=29229): Launched 05:33:41.796200 run osmo-stp_10.42.42.5: Starting osmo-stp 05:33:42.367447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29232): Launched 05:33:42.699285 run osmo-stp_10.42.42.5(pid=29233): Launched 05:33:42.832449 tst emergency_preemptive_call.py: using MSISDN 7048 05:33:43.001963 run osmo-msc_10.42.42.6: Starting osmo-msc 05:33:43.593569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29235): Launched 05:33:43.924240 run osmo-msc_10.42.42.6(pid=29236): Launched 05:33:44.114433 run osmo-stp_10.42.42.5(pid=29233): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29233)] 05:33:44.253938 run osmo-stp_10.42.42.5(pid=29233): stdout: | (launched: 2022-12-09_05:33:42.637224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:44.392745 run osmo-stp_10.42.42.5(pid=29233): stderr: | 20221209053342832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053342833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053342833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053342833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053342835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053342836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053342836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:44.529977 run osmo-stp_10.42.42.5(pid=29233): stdout: | (launched: 2022-12-09_05:33:42.637224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:33:44.660235 run osmo-stp_10.42.42.5(pid=29233): stderr: | 20221209053342832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053342833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053342833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053342833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053342835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053342836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053342836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:33:44.816455 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29233): Process ended prematurely: osmo-stp_10.42.42.5(pid=29233) [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29233)] [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py:32] 05:33:44.825381 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 05:33:44.852750 run osmo-hlr_10.42.42.2(pid=29229): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29229)] 05:33:44.903379 run osmo-hlr_10.42.42.2(pid=29229): stdout: | (launched: 2022-12-09_05:33:41.606952) 05:33:44.955749 run osmo-hlr_10.42.42.2(pid=29229): stderr: | 20221209053341806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053341807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053341807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053341807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053341807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053341807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053341823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053341833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053341833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053341833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:33:45.028598 run osmo-msc_10.42.42.6(pid=29236): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29236)] 05:33:45.079029 run osmo-msc_10.42.42.6(pid=29236): stdout: | (launched: 2022-12-09_05:33:43.862593) 05:33:45.131057 run osmo-msc_10.42.42.6(pid=29236): stderr: | 20221209053344189 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053344189 DLGLOBAL DEBUG validating counter group 0x7f677946ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053344189 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053344189 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053344189 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053344189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053344191 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053344191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053344192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053344192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:33:45.183814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29228): Terminating (SIGTERM) 05:33:45.226130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29232): Terminating (SIGTERM) 05:33:45.268233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29235): Terminating (SIGTERM) 05:33:45.310660 --- ParallelTerminationStrategy: PID 29228 died... 05:33:45.330873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29228): Terminated: ok {rc=0} 05:33:45.377663 --- ParallelTerminationStrategy: PID 29232 died... 05:33:45.397453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29232): Terminated: ok {rc=0} 05:33:45.443649 --- ParallelTerminationStrategy: PID 29235 died... 05:33:45.463152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29235): Terminated: ok {rc=0} 05:33:45.550714 bus /sierra_9: Setting Powered False 05:33:46.652890 bus /sierra_9: Setting Powered False 05:33:47.769975 bus /sierra_8: Setting Powered False 05:33:48.869071 bus /sierra_8: Setting Powered False 05:33:49.986644 bus /sierra_3: Setting Powered False 05:33:51.085781 bus /sierra_3: Setting Powered False 05:33:52.203086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:sysmo --------------------------------------------------------------------- 05:33:53.470921 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:33:53.475165 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 05:33:53.495885 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 05:33:53.536546 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 05:33:53.625406 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 05:33:53.646761 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 05:33:53.685392 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 05:33:54.272162 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 05:33:54.324362 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.335392 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:33:54.370868 tst cs_paging_gprs_active.py: using LAC 19279 05:33:54.498400 tst cs_paging_gprs_active.py: using RAC 154 05:33:54.623000 tst cs_paging_gprs_active.py: using CellId 19279 05:33:54.747932 tst cs_paging_gprs_active.py: using BVCI 19280 05:33:54.863481 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.874423 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.885108 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.896081 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.907068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.918150 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.929381 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.940255 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:33:54.951451 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:55.070973 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:33:55.188029 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:33:55.399107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:55.716054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Launched 05:33:55.990239 run iperf3-srv_10.42.42.10(pid=29243): Launched 05:33:56.108550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:33:56.317881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:33:56.633104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29244): Launched 05:33:56.906834 run iperf3-srv_10.42.42.10(pid=29245): Launched 05:33:57.024162 tst cs_paging_gprs_active.py:38: start network... 05:33:57.233410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:33:57.720666 run create_hlr_db(pid=29246): Launched 05:33:57.840558 bus /sierra_2: Setting Powered False 05:33:58.902503 run create_hlr_db(pid=29246): Terminated: ok {rc=0} 05:33:59.361918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Launched 05:33:59.700015 run osmo-hlr_10.42.42.2(pid=29249): Launched 05:33:59.827904 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:00.411041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Launched 05:34:00.747748 run osmo-stp_10.42.42.5(pid=29252): Launched 05:34:00.942747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:02.653843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29254): Launched 05:34:02.782391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:03.068188 run patchelf(pid=29255): Launched 05:34:03.256434 run osmo-stp_10.42.42.5(pid=29252): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] 05:34:03.398365 run osmo-stp_10.42.42.5(pid=29252): stdout: | (launched: 2022-12-09_05:34:00.684768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:03.541186 run osmo-stp_10.42.42.5(pid=29252): stderr: | 20221209053400907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053400907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053400907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053400908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053400908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053400908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053400908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:03.684375 run osmo-stp_10.42.42.5(pid=29252): stdout: | (launched: 2022-12-09_05:34:00.684768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:03.821955 run osmo-stp_10.42.42.5(pid=29252): stderr: | 20221209053400907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053400907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053400907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053400908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053400908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053400908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053400908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:03.984313 run patchelf(pid=29255): Terminating (SIGINT) 05:34:04.172325 run patchelf(pid=29255): Terminated: ok {rc=0} 05:34:04.307879 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29252): Process ended prematurely: osmo-stp_10.42.42.5(pid=29252) [trial-2355↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] [trial-2355↪gprs:sysmo↪cs_paging_gprs_active.py:38] 05:34:04.317853 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 05:34:04.346614 run osmo-hlr_10.42.42.2(pid=29249): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29249)] 05:34:04.396927 run osmo-hlr_10.42.42.2(pid=29249): stdout: | (launched: 2022-12-09_05:33:59.636389) 05:34:04.449239 run osmo-hlr_10.42.42.2(pid=29249): stderr: | 20221209053359840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053359840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053359840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053359840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053359840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053359840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053359855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053359863 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053359863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053359863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:04.502006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Terminating (SIGTERM) 05:34:04.544372 run iperf3-srv_10.42.42.10(pid=29243): Terminating (SIGTERM) 05:34:04.586795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29244): Terminating (SIGTERM) 05:34:04.629394 run iperf3-srv_10.42.42.10(pid=29245): Terminating (SIGTERM) 05:34:04.671786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Terminating (SIGTERM) 05:34:04.714474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Terminating (SIGTERM) 05:34:04.756775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29254): Terminating (SIGTERM) 05:34:04.799202 --- ParallelTerminationStrategy: PID 29242 died... 05:34:04.819385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29242): Terminated: ok {rc=0} 05:34:04.866672 --- ParallelTerminationStrategy: PID 29243 died... 05:34:04.886248 run iperf3-srv_10.42.42.10(pid=29243): Terminated {rc=256} 05:34:04.932620 --- ParallelTerminationStrategy: PID 29244 died... 05:34:04.952479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29244): Terminated: ok {rc=0} 05:34:04.999413 --- ParallelTerminationStrategy: PID 29245 died... 05:34:05.019448 run iperf3-srv_10.42.42.10(pid=29245): Terminated {rc=256} 05:34:05.066238 --- ParallelTerminationStrategy: PID 29248 died... 05:34:05.085972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29248): Terminated: ok {rc=0} 05:34:05.132370 --- ParallelTerminationStrategy: PID 29251 died... 05:34:05.152407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29251): Terminated: ok {rc=0} 05:34:05.198887 --- ParallelTerminationStrategy: PID 29254 died... 05:34:05.219062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29254): Terminated: ok {rc=0} 05:34:05.308048 bus /gobi_0: Setting Powered False 05:34:06.409509 bus /gobi_0: Setting Powered False 05:34:07.528162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo iperf3.py ---------------------------------------------- 05:34:08.681474 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:08.693477 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:08.730268 tst iperf3.py: using LAC 19280 05:34:08.863019 tst iperf3.py: using RAC 155 05:34:08.996764 tst iperf3.py: using CellId 19280 05:34:09.129830 tst iperf3.py: using BVCI 19281 05:34:09.247176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.257843 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.268426 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.279030 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.290343 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.301637 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.312461 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.323172 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:09.333956 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:09.454702 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:09.682391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:10.019719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Launched 05:34:10.314794 run iperf3-srv_10.42.42.10(pid=29257): Launched 05:34:10.440566 tst iperf3.py:8: start network... 05:34:10.665883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:11.186922 run create_hlr_db(pid=29258): Launched 05:34:11.322708 bus /gobi_6: Setting Powered False 05:34:12.388740 run create_hlr_db(pid=29258): Terminated: ok {rc=0} 05:34:12.835481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Launched 05:34:13.150933 run osmo-hlr_10.42.42.2(pid=29261): Launched 05:34:13.270797 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:13.826675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Launched 05:34:14.140545 run osmo-stp_10.42.42.5(pid=29264): Launched 05:34:14.259463 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:14.797975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29266): Launched 05:34:14.918236 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:15.184174 run patchelf(pid=29267): Launched 05:34:15.357907 run osmo-stp_10.42.42.5(pid=29264): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29264)] 05:34:15.490060 run osmo-stp_10.42.42.5(pid=29264): stdout: | (launched: 2022-12-09_05:34:14.080825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:15.623746 run osmo-stp_10.42.42.5(pid=29264): stderr: | 20221209053414256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053414256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053414256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053414257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053414257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053414257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053414257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:15.757567 run osmo-stp_10.42.42.5(pid=29264): stdout: | (launched: 2022-12-09_05:34:14.080825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:15.906473 run osmo-stp_10.42.42.5(pid=29264): stderr: | 20221209053414256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053414256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053414256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053414257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053414257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053414257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053414257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:16.077177 run patchelf(pid=29267): Terminating (SIGINT) 05:34:16.270293 run patchelf(pid=29267): Terminated: ok {rc=0} 05:34:16.410617 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29264): Process ended prematurely: osmo-stp_10.42.42.5(pid=29264) [trial-2355↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29264)] [trial-2355↪gprs:sysmo↪iperf3.py:8] 05:34:16.421578 tst iperf3.py:8: Test FAILED (7.8 sec) 05:34:16.451734 run osmo-hlr_10.42.42.2(pid=29261): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29261)] 05:34:16.505358 run osmo-hlr_10.42.42.2(pid=29261): stdout: | (launched: 2022-12-09_05:34:13.091307) 05:34:16.560155 run osmo-hlr_10.42.42.2(pid=29261): stderr: | 20221209053413270 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053413271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053413271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053413271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053413271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053413271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053413283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053413291 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053413292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053413292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:16.614398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminating (SIGTERM) 05:34:16.659143 run iperf3-srv_10.42.42.10(pid=29257): Terminating (SIGTERM) 05:34:16.704336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Terminating (SIGTERM) 05:34:16.748614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Terminating (SIGTERM) 05:34:16.795202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29266): Terminating (SIGTERM) 05:34:16.841710 --- ParallelTerminationStrategy: PID 29256 died... 05:34:16.862594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29256): Terminated: ok {rc=0} 05:34:16.913373 --- ParallelTerminationStrategy: PID 29257 died... 05:34:16.934028 run iperf3-srv_10.42.42.10(pid=29257): Terminated {rc=256} 05:34:16.981692 --- ParallelTerminationStrategy: PID 29260 died... 05:34:17.002108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29260): Terminated: ok {rc=0} 05:34:17.050140 --- ParallelTerminationStrategy: PID 29263 died... 05:34:17.070739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29263): Terminated: ok {rc=0} 05:34:17.120329 --- ParallelTerminationStrategy: PID 29266 died... 05:34:17.142226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29266): Terminated: ok {rc=0} 05:34:17.236182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo iperf3m4.py ---------------------------------------------- 05:34:18.384557 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.396014 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:18.431948 tst iperf3m4.py: using LAC 19281 05:34:18.554756 tst iperf3m4.py: using RAC 156 05:34:18.678682 tst iperf3m4.py: using CellId 19281 05:34:18.802143 tst iperf3m4.py: using BVCI 19282 05:34:18.917949 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.928486 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.939165 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.949948 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.960480 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.971068 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.981885 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:18.992483 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:19.003273 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.124575 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.245289 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.366142 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:19.485027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:34:19.694808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:20.010404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29268): Launched 05:34:20.285016 run iperf3-srv_10.42.42.10(pid=29269): Launched 05:34:20.403222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:34:20.613244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:20.928721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29270): Launched 05:34:21.202982 run iperf3-srv_10.42.42.10(pid=29271): Launched 05:34:21.320684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:34:21.530009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:21.845119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29272): Launched 05:34:22.118705 run iperf3-srv_10.42.42.10(pid=29273): Launched 05:34:22.236000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:34:22.445311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:22.760495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29274): Launched 05:34:23.050909 run iperf3-srv_10.42.42.10(pid=29275): Launched 05:34:23.168547 tst iperf3m4.py:8: start network... 05:34:23.377793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:23.864865 run create_hlr_db(pid=29276): Launched 05:34:23.984321 bus /gobi_6: Setting Powered False 05:34:25.045726 run create_hlr_db(pid=29276): Terminated: ok {rc=0} 05:34:25.505617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29278): Launched 05:34:25.842815 run osmo-hlr_10.42.42.2(pid=29279): Launched 05:34:25.969772 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:26.551972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29281): Launched 05:34:26.890010 run osmo-stp_10.42.42.5(pid=29282): Launched 05:34:27.016939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:27.601021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29284): Launched 05:34:27.729268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:28.014755 run patchelf(pid=29285): Launched 05:34:28.201362 run osmo-stp_10.42.42.5(pid=29282): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29282)] 05:34:28.343000 run osmo-stp_10.42.42.5(pid=29282): stdout: | (launched: 2022-12-09_05:34:26.825193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:28.486476 run osmo-stp_10.42.42.5(pid=29282): stderr: | 20221209053427023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053427023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053427023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053427024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053427026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053427026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053427026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:28.629186 run osmo-stp_10.42.42.5(pid=29282): stdout: | (launched: 2022-12-09_05:34:26.825193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:28.767255 run osmo-stp_10.42.42.5(pid=29282): stderr: | 20221209053427023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053427023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053427023 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053427024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053427026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053427026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053427026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:28.930746 run patchelf(pid=29285): Terminating (SIGINT) 05:34:29.117510 run patchelf(pid=29285): Terminated: ok {rc=0} 05:34:29.252485 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29282): Process ended prematurely: osmo-stp_10.42.42.5(pid=29282) [trial-2355↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29282)] [trial-2355↪gprs:sysmo↪iperf3m4.py:8] 05:34:29.262743 tst iperf3m4.py:8: Test FAILED (10.9 sec) 05:34:29.291775 run osmo-hlr_10.42.42.2(pid=29279): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29279)] 05:34:29.343345 run osmo-hlr_10.42.42.2(pid=29279): stdout: | (launched: 2022-12-09_05:34:25.779549) 05:34:29.396486 run osmo-hlr_10.42.42.2(pid=29279): stderr: | 20221209053425984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053425984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053425984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053425984 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053425984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053425984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053425997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053426005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053426006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053426006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:29.450081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29268): Terminating (SIGTERM) 05:34:29.493181 run iperf3-srv_10.42.42.10(pid=29269): Terminating (SIGTERM) 05:34:29.536054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29270): Terminating (SIGTERM) 05:34:29.579576 run iperf3-srv_10.42.42.10(pid=29271): Terminating (SIGTERM) 05:34:29.622833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29272): Terminating (SIGTERM) 05:34:29.665903 run iperf3-srv_10.42.42.10(pid=29273): Terminating (SIGTERM) 05:34:29.708829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29274): Terminating (SIGTERM) 05:34:29.751843 run iperf3-srv_10.42.42.10(pid=29275): Terminating (SIGTERM) 05:34:29.794871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29278): Terminating (SIGTERM) 05:34:29.838048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29281): Terminating (SIGTERM) 05:34:29.881064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29284): Terminating (SIGTERM) 05:34:29.924176 --- ParallelTerminationStrategy: PID 29268 died... 05:34:29.944730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29268): Terminated: ok {rc=0} 05:34:29.992773 --- ParallelTerminationStrategy: PID 29269 died... 05:34:30.013201 run iperf3-srv_10.42.42.10(pid=29269): Terminated {rc=256} 05:34:30.060537 --- ParallelTerminationStrategy: PID 29270 died... 05:34:30.080482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29270): Terminated: ok {rc=0} 05:34:30.127724 --- ParallelTerminationStrategy: PID 29271 died... 05:34:30.147846 run iperf3-srv_10.42.42.10(pid=29271): Terminated {rc=256} 05:34:30.195239 --- ParallelTerminationStrategy: PID 29272 died... 05:34:30.215442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29272): Terminated: ok {rc=0} 05:34:30.262650 --- ParallelTerminationStrategy: PID 29273 died... 05:34:30.282740 run iperf3-srv_10.42.42.10(pid=29273): Terminated {rc=256} 05:34:30.329912 --- ParallelTerminationStrategy: PID 29274 died... 05:34:30.350271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29274): Terminated: ok {rc=0} 05:34:30.397718 --- ParallelTerminationStrategy: PID 29275 died... 05:34:30.417769 run iperf3-srv_10.42.42.10(pid=29275): Terminated {rc=256} 05:34:30.464801 --- ParallelTerminationStrategy: PID 29278 died... 05:34:30.484841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29278): Terminated: ok {rc=0} 05:34:30.531893 --- ParallelTerminationStrategy: PID 29281 died... 05:34:30.552072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29281): Terminated: ok {rc=0} 05:34:30.599379 --- ParallelTerminationStrategy: PID 29284 died... 05:34:30.619438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29284): Terminated: ok {rc=0} 05:34:30.709846 bus /gobi_4: Setting Powered False 05:34:31.815929 bus /gobi_4: Setting Powered False 05:34:32.944517 bus /gobi_1: Setting Powered False 05:34:34.044296 bus /gobi_1: Setting Powered False 05:34:35.162260 bus /gobi_0: Setting Powered False 05:34:36.259332 bus /gobi_0: Setting Powered False 05:34:37.377165 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo ping.py ---------------------------------------------- 05:34:38.482505 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:38.493956 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:38.532938 tst ping.py: using LAC 19282 05:34:38.657165 tst ping.py: using RAC 157 05:34:38.777159 tst ping.py: using CellId 19282 05:34:38.896649 tst ping.py: using BVCI 19283 05:34:39.008240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.019137 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.029831 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.040563 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.051217 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.061946 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.072681 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:39.083622 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:39.204033 tst ping.py:19: start network... 05:34:39.427681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:39.941170 run create_hlr_db(pid=29286): Launched 05:34:40.075065 bus /gobi_6: Setting Powered False 05:34:41.139707 run create_hlr_db(pid=29286): Terminated: ok {rc=0} 05:34:41.579933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29288): Launched 05:34:41.889381 run osmo-hlr_10.42.42.2(pid=29289): Launched 05:34:42.006028 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:42.548293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29291): Launched 05:34:42.857243 run osmo-stp_10.42.42.5(pid=29292): Launched 05:34:42.974692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:43.505080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29294): Launched 05:34:43.632418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:43.911745 run patchelf(pid=29295): Launched 05:34:44.095027 run osmo-stp_10.42.42.5(pid=29292): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29292)] 05:34:44.234741 run osmo-stp_10.42.42.5(pid=29292): stdout: | (launched: 2022-12-09_05:34:42.798652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:44.375989 run osmo-stp_10.42.42.5(pid=29292): stderr: | 20221209053442971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053442971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053442971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053442972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053442972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053442972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053442972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:44.517726 run osmo-stp_10.42.42.5(pid=29292): stdout: | (launched: 2022-12-09_05:34:42.798652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:44.652188 run osmo-stp_10.42.42.5(pid=29292): stderr: | 20221209053442971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053442971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053442971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053442972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053442972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053442972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053442972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:44.811689 run patchelf(pid=29295): Terminating (SIGINT) 05:34:44.995532 run patchelf(pid=29295): Terminated: ok {rc=0} 05:34:45.128059 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29292): Process ended prematurely: osmo-stp_10.42.42.5(pid=29292) [trial-2355↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29292)] [trial-2355↪gprs:sysmo↪ping.py:22] 05:34:45.137483 tst ping.py:22: Test FAILED (6.6 sec) 05:34:45.165793 run osmo-hlr_10.42.42.2(pid=29289): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29289)] 05:34:45.217142 run osmo-hlr_10.42.42.2(pid=29289): stdout: | (launched: 2022-12-09_05:34:41.830771) 05:34:45.269891 run osmo-hlr_10.42.42.2(pid=29289): stderr: | 20221209053442011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053442011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053442011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053442011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053442011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053442011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053442027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053442037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053442038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053442038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:45.323076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29288): Terminating (SIGTERM) 05:34:45.365767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29291): Terminating (SIGTERM) 05:34:45.408454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29294): Terminating (SIGTERM) 05:34:45.452058 --- ParallelTerminationStrategy: PID 29288 died... 05:34:45.472531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29288): Terminated: ok {rc=0} 05:34:45.519696 --- ParallelTerminationStrategy: PID 29291 died... 05:34:45.539767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29291): Terminated: ok {rc=0} 05:34:45.587262 --- ParallelTerminationStrategy: PID 29294 died... 05:34:45.607295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29294): Terminated: ok {rc=0} 05:34:45.696493 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 05:34:46.787125 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:46.799385 tst gprs:sysmo: Using 1 x bts (candidates: 1) 05:34:46.839263 tst ping_idle_ping.py: using LAC 19283 05:34:47.002274 tst ping_idle_ping.py: using RAC 158 05:34:47.129770 tst ping_idle_ping.py: using CellId 19283 05:34:47.267011 tst ping_idle_ping.py: using BVCI 19284 05:34:47.380778 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.391625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.402647 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.413622 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.424374 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.435263 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.446347 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 05:34:47.457451 tst gprs:sysmo: Using 1 x modem (candidates: 4) 05:34:47.584684 tst ping_idle_ping.py:24: start network... 05:34:47.791884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:48.269266 run create_hlr_db(pid=29296): Launched 05:34:48.386745 bus /gobi_6: Setting Powered False 05:34:49.447918 run create_hlr_db(pid=29296): Terminated: ok {rc=0} 05:34:49.900745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Launched 05:34:50.232404 run osmo-hlr_10.42.42.2(pid=29299): Launched 05:34:50.357904 run osmo-stp_10.42.42.5: Starting osmo-stp 05:34:50.925845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Launched 05:34:51.257564 run osmo-stp_10.42.42.5(pid=29302): Launched 05:34:51.383207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:34:51.954480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29304): Launched 05:34:52.082776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:34:52.363851 run patchelf(pid=29305): Launched 05:34:52.548387 run osmo-stp_10.42.42.5(pid=29302): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] 05:34:52.687589 run osmo-stp_10.42.42.5(pid=29302): stdout: | (launched: 2022-12-09_05:34:51.195478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:52.828405 run osmo-stp_10.42.42.5(pid=29302): stderr: | 20221209053451393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053451393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053451393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053451394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053451394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053451394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053451394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:52.969137 run osmo-stp_10.42.42.5(pid=29302): stdout: | (launched: 2022-12-09_05:34:51.195478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:34:53.103501 run osmo-stp_10.42.42.5(pid=29302): stderr: | 20221209053451393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053451393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053451393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053451394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053451394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053451394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053451394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:34:53.263882 run patchelf(pid=29305): Terminating (SIGINT) 05:34:53.447915 run patchelf(pid=29305): Terminated: ok {rc=0} 05:34:53.581352 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29302): Process ended prematurely: osmo-stp_10.42.42.5(pid=29302) [trial-2355↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] [trial-2355↪gprs:sysmo↪ping_idle_ping.py:27] 05:34:53.590714 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 05:34:53.618559 run osmo-hlr_10.42.42.2(pid=29299): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29299)] 05:34:53.668719 run osmo-hlr_10.42.42.2(pid=29299): stdout: | (launched: 2022-12-09_05:34:50.170148) 05:34:53.720654 run osmo-hlr_10.42.42.2(pid=29299): stderr: | 20221209053450374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053450374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053450374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053450374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053450374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053450374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053450386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053450394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053450394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053450394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:34:53.773127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Terminating (SIGTERM) 05:34:53.815154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Terminating (SIGTERM) 05:34:53.857292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29304): Terminating (SIGTERM) 05:34:53.899664 --- ParallelTerminationStrategy: PID 29298 died... 05:34:53.919783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29298): Terminated: ok {rc=0} 05:34:53.966214 --- ParallelTerminationStrategy: PID 29301 died... 05:34:53.985944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29301): Terminated: ok {rc=0} 05:34:54.032261 --- ParallelTerminationStrategy: PID 29304 died... 05:34:54.051976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29304): Terminated: ok {rc=0} 05:34:54.139710 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 05:34:55.430378 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:34:55.436123 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:34:55.457652 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:34:55.497264 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:34:55.586380 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:34:55.607747 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:34:55.647120 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:34:56.243012 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:34:56.296727 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.308048 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:34:56.345997 tst cs_paging_gprs_active.py: using LAC 19284 05:34:56.477133 tst cs_paging_gprs_active.py: using RAC 159 05:34:56.610651 tst cs_paging_gprs_active.py: using CellId 19284 05:34:56.741429 tst cs_paging_gprs_active.py: using BVCI 19285 05:34:56.866397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.877814 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.888776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.900066 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.911075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.922088 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.933383 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.944351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:34:56.955785 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:57.072931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:34:57.194886 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:34:57.421459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:57.760514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29311): Launched 05:34:58.053694 run iperf3-srv_10.42.42.10(pid=29312): Launched 05:34:58.180126 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:34:58.406382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:34:58.745128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29313): Launched 05:34:59.040241 run iperf3-srv_10.42.42.10(pid=29314): Launched 05:34:59.166235 tst cs_paging_gprs_active.py:38: start network... 05:34:59.392558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:34:59.915470 run create_hlr_db(pid=29315): Launched 05:35:00.052037 bus /gobi_6: Setting Powered False 05:35:01.116727 run create_hlr_db(pid=29315): Terminated: ok {rc=0} 05:35:01.611432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29320): Launched 05:35:01.950366 run osmo-hlr_10.42.42.2(pid=29321): Launched 05:35:02.193393 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:02.751449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29323): Launched 05:35:03.066950 run osmo-stp_10.42.42.5(pid=29324): Launched 05:35:03.187042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:03.729181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29326): Launched 05:35:03.849318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:04.115223 run patchelf(pid=29327): Launched 05:35:04.289538 run osmo-stp_10.42.42.5(pid=29324): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29324)] 05:35:04.422214 run osmo-stp_10.42.42.5(pid=29324): stdout: | (launched: 2022-12-09_05:35:03.007439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:04.555907 run osmo-stp_10.42.42.5(pid=29324): stderr: | 20221209053503184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053503184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053503184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053503184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053503185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053503185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053503185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:04.690794 run osmo-stp_10.42.42.5(pid=29324): stdout: | (launched: 2022-12-09_05:35:03.007439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:04.818934 run osmo-stp_10.42.42.5(pid=29324): stderr: | 20221209053503184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053503184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053503184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053503184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053503185 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053503185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053503185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:04.971253 run patchelf(pid=29327): Terminating (SIGINT) 05:35:05.146397 run patchelf(pid=29327): Terminated: ok {rc=0} 05:35:05.273103 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29324): Process ended prematurely: osmo-stp_10.42.42.5(pid=29324) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29324)] [trial-2355↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:35:05.282514 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 05:35:05.310371 run osmo-hlr_10.42.42.2(pid=29321): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29321)] 05:35:05.358951 run osmo-hlr_10.42.42.2(pid=29321): stdout: | (launched: 2022-12-09_05:35:01.885543) 05:35:05.409324 run osmo-hlr_10.42.42.2(pid=29321): stderr: | 20221209053502215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053502215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053502215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053502215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053502215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053502216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053502228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053502238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053502238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053502238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:05.460025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29311): Terminating (SIGTERM) 05:35:05.501033 run iperf3-srv_10.42.42.10(pid=29312): Terminating (SIGTERM) 05:35:05.541576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29313): Terminating (SIGTERM) 05:35:05.582394 run iperf3-srv_10.42.42.10(pid=29314): Terminating (SIGTERM) 05:35:05.622948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29320): Terminating (SIGTERM) 05:35:05.663673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29323): Terminating (SIGTERM) 05:35:05.704215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29326): Terminating (SIGTERM) 05:35:05.745091 --- ParallelTerminationStrategy: PID 29311 died... 05:35:05.764468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29311): Terminated: ok {rc=0} 05:35:05.809658 --- ParallelTerminationStrategy: PID 29312 died... 05:35:05.828378 run iperf3-srv_10.42.42.10(pid=29312): Terminated {rc=256} 05:35:05.873233 --- ParallelTerminationStrategy: PID 29313 died... 05:35:05.892127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29313): Terminated: ok {rc=0} 05:35:05.936832 --- ParallelTerminationStrategy: PID 29314 died... 05:35:05.956002 run iperf3-srv_10.42.42.10(pid=29314): Terminated {rc=256} 05:35:06.000810 --- ParallelTerminationStrategy: PID 29320 died... 05:35:06.019936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29320): Terminated: ok {rc=0} 05:35:06.065155 --- ParallelTerminationStrategy: PID 29323 died... 05:35:06.083830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29323): Terminated: ok {rc=0} 05:35:06.128785 --- ParallelTerminationStrategy: PID 29326 died... 05:35:06.147593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29326): Terminated: ok {rc=0} 05:35:06.232626 bus /gobi_0: Setting Powered False 05:35:07.332237 bus /gobi_0: Setting Powered False 05:35:08.450374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:35:09.603124 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:09.615315 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:09.654004 tst iperf3.py: using LAC 19285 05:35:09.786624 tst iperf3.py: using RAC 160 05:35:09.918701 tst iperf3.py: using CellId 19285 05:35:10.051502 tst iperf3.py: using BVCI 19286 05:35:10.175256 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.186888 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.198170 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.209377 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.220407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.231463 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.242840 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.253908 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:10.265199 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:10.388384 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:10.599869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:10.915532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29328): Launched 05:35:11.189435 run iperf3-srv_10.42.42.10(pid=29329): Launched 05:35:11.306968 tst iperf3.py:8: start network... 05:35:11.516078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:12.002079 run create_hlr_db(pid=29330): Launched 05:35:12.122268 bus /gobi_6: Setting Powered False 05:35:13.185026 run create_hlr_db(pid=29330): Terminated: ok {rc=0} 05:35:13.619939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Launched 05:35:13.934652 run osmo-hlr_10.42.42.2(pid=29333): Launched 05:35:14.053840 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:14.605348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Launched 05:35:14.919623 run osmo-stp_10.42.42.5(pid=29336): Launched 05:35:15.039009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:15.580160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Launched 05:35:15.700515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:15.981701 run patchelf(pid=29339): Launched 05:35:16.171283 run osmo-stp_10.42.42.5(pid=29336): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] 05:35:16.306799 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-09_05:35:14.860031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:16.444365 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221209053515033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053515033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053515033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053515033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053515034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053515034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053515034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:16.581663 run osmo-stp_10.42.42.5(pid=29336): stdout: | (launched: 2022-12-09_05:35:14.860031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:16.714366 run osmo-stp_10.42.42.5(pid=29336): stderr: | 20221209053515033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053515033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053515033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053515033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053515034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053515034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053515034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:16.870654 run patchelf(pid=29339): Terminating (SIGINT) 05:35:17.050506 run patchelf(pid=29339): Terminated: ok {rc=0} 05:35:17.181305 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 05:35:17.193105 tst iperf3.py:8: Test FAILED (7.6 sec) 05:35:17.222992 run osmo-hlr_10.42.42.2(pid=29333): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29333)] 05:35:17.274501 run osmo-hlr_10.42.42.2(pid=29333): stdout: | (launched: 2022-12-09_05:35:13.875444) 05:35:17.327369 run osmo-hlr_10.42.42.2(pid=29333): stderr: | 20221209053514053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053514053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053514053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053514053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053514053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053514053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053514065 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053514073 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053514074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053514074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:17.380250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29328): Terminating (SIGTERM) 05:35:17.423410 run iperf3-srv_10.42.42.10(pid=29329): Terminating (SIGTERM) 05:35:17.466161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminating (SIGTERM) 05:35:17.509126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminating (SIGTERM) 05:35:17.551853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Terminating (SIGTERM) 05:35:17.594772 --- ParallelTerminationStrategy: PID 29328 died... 05:35:17.615258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29328): Terminated: ok {rc=0} 05:35:17.662734 --- ParallelTerminationStrategy: PID 29329 died... 05:35:17.683182 run iperf3-srv_10.42.42.10(pid=29329): Terminated {rc=256} 05:35:17.730224 --- ParallelTerminationStrategy: PID 29332 died... 05:35:17.750118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29332): Terminated: ok {rc=0} 05:35:17.797056 --- ParallelTerminationStrategy: PID 29335 died... 05:35:17.817224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29335): Terminated: ok {rc=0} 05:35:17.864587 --- ParallelTerminationStrategy: PID 29338 died... 05:35:17.884738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29338): Terminated: ok {rc=0} 05:35:17.975354 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:35:19.128489 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.140682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:19.177738 tst iperf3m4.py: using LAC 19286 05:35:19.299886 tst iperf3m4.py: using RAC 161 05:35:19.431384 tst iperf3m4.py: using CellId 19286 05:35:19.553421 tst iperf3m4.py: using BVCI 19287 05:35:19.667088 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.678224 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.689414 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.700328 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.711665 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.722682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.733936 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.744749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:19.755715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:19.873541 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:19.997594 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:20.115168 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:20.231898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:35:20.443408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:20.762298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Launched 05:35:21.038026 run iperf3-srv_10.42.42.10(pid=29341): Launched 05:35:21.156389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:35:21.366778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:21.683517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Launched 05:35:21.959009 run iperf3-srv_10.42.42.10(pid=29343): Launched 05:35:22.077285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:35:22.286623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:22.602856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Launched 05:35:22.878495 run iperf3-srv_10.42.42.10(pid=29345): Launched 05:35:22.996722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:35:23.207120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:23.523289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Launched 05:35:23.798731 run iperf3-srv_10.42.42.10(pid=29347): Launched 05:35:23.919097 tst iperf3m4.py:8: start network... 05:35:24.128752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:24.616564 run create_hlr_db(pid=29348): Launched 05:35:24.736218 bus /gobi_6: Setting Powered False 05:35:25.798597 run create_hlr_db(pid=29348): Terminated: ok {rc=0} 05:35:26.257232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Launched 05:35:26.594590 run osmo-hlr_10.42.42.2(pid=29351): Launched 05:35:26.721452 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:27.299984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Launched 05:35:27.636233 run osmo-stp_10.42.42.5(pid=29354): Launched 05:35:27.763764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:28.344379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29356): Launched 05:35:28.472416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:28.757859 run patchelf(pid=29357): Launched 05:35:28.944450 run osmo-stp_10.42.42.5(pid=29354): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] 05:35:29.085944 run osmo-stp_10.42.42.5(pid=29354): stdout: | (launched: 2022-12-09_05:35:27.573365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:29.228927 run osmo-stp_10.42.42.5(pid=29354): stderr: | 20221209053527771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053527772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053527772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053527772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053527773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053527773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053527773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:29.371856 run osmo-stp_10.42.42.5(pid=29354): stdout: | (launched: 2022-12-09_05:35:27.573365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:29.509681 run osmo-stp_10.42.42.5(pid=29354): stderr: | 20221209053527771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053527772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053527772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053527772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053527773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053527773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053527773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:29.672864 run patchelf(pid=29357): Terminating (SIGINT) 05:35:29.860045 run patchelf(pid=29357): Terminated: ok {rc=0} 05:35:29.994737 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29354): Process ended prematurely: osmo-stp_10.42.42.5(pid=29354) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 05:35:30.004745 tst iperf3m4.py:8: Test FAILED (10.9 sec) 05:35:30.033827 run osmo-hlr_10.42.42.2(pid=29351): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29351)] 05:35:30.084900 run osmo-hlr_10.42.42.2(pid=29351): stdout: | (launched: 2022-12-09_05:35:26.531493) 05:35:30.137533 run osmo-hlr_10.42.42.2(pid=29351): stderr: | 20221209053526735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053526735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053526735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053526735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053526735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053526735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053526747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053526756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053526756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053526756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:30.190666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminating (SIGTERM) 05:35:30.233543 run iperf3-srv_10.42.42.10(pid=29341): Terminating (SIGTERM) 05:35:30.276013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Terminating (SIGTERM) 05:35:30.318677 run iperf3-srv_10.42.42.10(pid=29343): Terminating (SIGTERM) 05:35:30.360931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Terminating (SIGTERM) 05:35:30.403360 run iperf3-srv_10.42.42.10(pid=29345): Terminating (SIGTERM) 05:35:30.445689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Terminating (SIGTERM) 05:35:30.488091 run iperf3-srv_10.42.42.10(pid=29347): Terminating (SIGTERM) 05:35:30.530566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Terminating (SIGTERM) 05:35:30.573276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Terminating (SIGTERM) 05:35:30.615663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29356): Terminating (SIGTERM) 05:35:30.658188 --- ParallelTerminationStrategy: PID 29340 died... 05:35:30.678477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29340): Terminated: ok {rc=0} 05:35:30.725528 --- ParallelTerminationStrategy: PID 29341 died... 05:35:30.745291 run iperf3-srv_10.42.42.10(pid=29341): Terminated {rc=256} 05:35:30.791843 --- ParallelTerminationStrategy: PID 29342 died... 05:35:30.811596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29342): Terminated: ok {rc=0} 05:35:30.860676 --- ParallelTerminationStrategy: PID 29343 died... 05:35:30.880783 run iperf3-srv_10.42.42.10(pid=29343): Terminated {rc=256} 05:35:30.928764 --- ParallelTerminationStrategy: PID 29344 died... 05:35:30.948720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29344): Terminated: ok {rc=0} 05:35:30.995325 --- ParallelTerminationStrategy: PID 29345 died... 05:35:31.015606 run iperf3-srv_10.42.42.10(pid=29345): Terminated {rc=256} 05:35:31.065196 --- ParallelTerminationStrategy: PID 29346 died... 05:35:31.085659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29346): Terminated: ok {rc=0} 05:35:31.135081 --- ParallelTerminationStrategy: PID 29347 died... 05:35:31.155165 run iperf3-srv_10.42.42.10(pid=29347): Terminated {rc=256} 05:35:31.203535 --- ParallelTerminationStrategy: PID 29350 died... 05:35:31.223276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29350): Terminated: ok {rc=0} 05:35:31.271665 --- ParallelTerminationStrategy: PID 29353 died... 05:35:31.291790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29353): Terminated: ok {rc=0} 05:35:31.341823 --- ParallelTerminationStrategy: PID 29356 died... 05:35:31.362014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29356): Terminated: ok {rc=0} 05:35:31.453854 bus /gobi_4: Setting Powered False 05:35:32.553878 bus /gobi_4: Setting Powered False 05:35:33.668077 bus /gobi_1: Setting Powered False 05:35:34.765649 bus /gobi_1: Setting Powered False 05:35:35.883444 bus /gobi_0: Setting Powered False 05:35:36.984056 bus /gobi_0: Setting Powered False 05:35:38.102571 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 05:35:39.208528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.220631 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:39.259654 tst ping.py: using LAC 19287 05:35:39.388880 tst ping.py: using RAC 162 05:35:39.518691 tst ping.py: using CellId 19287 05:35:39.648766 tst ping.py: using BVCI 19288 05:35:39.762648 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.773749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.784639 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.795698 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.807002 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.818375 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.829878 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:39.841200 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:39.959250 tst ping.py:19: start network... 05:35:40.166706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:40.646937 run create_hlr_db(pid=29358): Launched 05:35:40.763997 bus /gobi_6: Setting Powered False 05:35:41.825507 run create_hlr_db(pid=29358): Terminated: ok {rc=0} 05:35:42.278635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29360): Launched 05:35:42.611153 run osmo-hlr_10.42.42.2(pid=29361): Launched 05:35:42.736083 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:43.303234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29363): Launched 05:35:43.633294 run osmo-stp_10.42.42.5(pid=29364): Launched 05:35:43.759333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:44.329466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29366): Launched 05:35:44.455812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:44.736189 run patchelf(pid=29367): Launched 05:35:44.919408 run osmo-stp_10.42.42.5(pid=29364): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29364)] 05:35:45.059169 run osmo-stp_10.42.42.5(pid=29364): stdout: | (launched: 2022-12-09_05:35:43.571291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:45.199733 run osmo-stp_10.42.42.5(pid=29364): stderr: | 20221209053543768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053543768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053543769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053543769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053543770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053543770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053543770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:45.340716 run osmo-stp_10.42.42.5(pid=29364): stdout: | (launched: 2022-12-09_05:35:43.571291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:45.474921 run osmo-stp_10.42.42.5(pid=29364): stderr: | 20221209053543768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053543768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053543769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053543769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053543770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053543770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053543770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:45.634547 run patchelf(pid=29367): Terminating (SIGINT) 05:35:45.818487 run patchelf(pid=29367): Terminated: ok {rc=0} 05:35:45.977037 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29364): Process ended prematurely: osmo-stp_10.42.42.5(pid=29364) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29364)] [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 05:35:45.987464 tst ping.py:22: Test FAILED (6.8 sec) 05:35:46.019092 run osmo-hlr_10.42.42.2(pid=29361): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29361)] 05:35:46.070514 run osmo-hlr_10.42.42.2(pid=29361): stdout: | (launched: 2022-12-09_05:35:42.548759) 05:35:46.123950 run osmo-hlr_10.42.42.2(pid=29361): stderr: | 20221209053542750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053542750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053542750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053542751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053542751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053542751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053542763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053542772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053542772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053542772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:46.178069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29360): Terminating (SIGTERM) 05:35:46.221544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29363): Terminating (SIGTERM) 05:35:46.265645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29366): Terminating (SIGTERM) 05:35:46.311120 --- ParallelTerminationStrategy: PID 29360 died... 05:35:46.331886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29360): Terminated: ok {rc=0} 05:35:46.381144 --- ParallelTerminationStrategy: PID 29363 died... 05:35:46.401978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29363): Terminated: ok {rc=0} 05:35:46.449681 --- ParallelTerminationStrategy: PID 29366 died... 05:35:46.470116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29366): Terminated: ok {rc=0} 05:35:46.559995 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:35:47.649404 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:47.661450 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:35:47.709822 tst ping_idle_ping.py: using LAC 19288 05:35:47.841034 tst ping_idle_ping.py: using RAC 163 05:35:47.969374 tst ping_idle_ping.py: using CellId 19288 05:35:48.100062 tst ping_idle_ping.py: using BVCI 19289 05:35:48.214175 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.225358 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.236340 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.248067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.259836 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.271450 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.283271 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:35:48.295250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:35:48.423896 tst ping_idle_ping.py:24: start network... 05:35:48.647813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:35:49.161342 run create_hlr_db(pid=29368): Launched 05:35:49.295752 bus /gobi_6: Setting Powered False 05:35:50.357343 run create_hlr_db(pid=29368): Terminated: ok {rc=0} 05:35:50.800912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29370): Launched 05:35:51.112303 run osmo-hlr_10.42.42.2(pid=29371): Launched 05:35:51.229764 run osmo-stp_10.42.42.5: Starting osmo-stp 05:35:51.777108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29373): Launched 05:35:52.087624 run osmo-stp_10.42.42.5(pid=29374): Launched 05:35:52.204420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:35:52.739247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29376): Launched 05:35:52.857834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:35:53.121125 run patchelf(pid=29377): Launched 05:35:53.293430 run osmo-stp_10.42.42.5(pid=29374): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29374)] 05:35:53.424152 run osmo-stp_10.42.42.5(pid=29374): stdout: | (launched: 2022-12-09_05:35:52.028714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:53.556375 run osmo-stp_10.42.42.5(pid=29374): stderr: | 20221209053552201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053552202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053552202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053552202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053552203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053552203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053552203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:53.688555 run osmo-stp_10.42.42.5(pid=29374): stdout: | (launched: 2022-12-09_05:35:52.028714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:35:53.814834 run osmo-stp_10.42.42.5(pid=29374): stderr: | 20221209053552201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053552202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053552202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053552202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053552203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053552203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053552203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:35:53.963929 run patchelf(pid=29377): Terminating (SIGINT) 05:35:54.137283 run patchelf(pid=29377): Terminated: ok {rc=0} 05:35:54.262073 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29374): Process ended prematurely: osmo-stp_10.42.42.5(pid=29374) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29374)] [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 05:35:54.271006 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 05:35:54.298504 run osmo-hlr_10.42.42.2(pid=29371): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29371)] 05:35:54.347447 run osmo-hlr_10.42.42.2(pid=29371): stdout: | (launched: 2022-12-09_05:35:51.053641) 05:35:54.397920 run osmo-hlr_10.42.42.2(pid=29371): stderr: | 20221209053551231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053551231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053551231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053551231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053551231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053551231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053551243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053551254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053551254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053551254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:35:54.448659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29370): Terminating (SIGTERM) 05:35:54.489368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29373): Terminating (SIGTERM) 05:35:54.529968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29376): Terminating (SIGTERM) 05:35:54.570878 --- ParallelTerminationStrategy: PID 29370 died... 05:35:54.590366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29370): Terminated: ok {rc=0} 05:35:54.635667 --- ParallelTerminationStrategy: PID 29373 died... 05:35:54.654736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29373): Terminated: ok {rc=0} 05:35:54.699960 --- ParallelTerminationStrategy: PID 29376 died... 05:35:54.719193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29376): Terminated: ok {rc=0} 05:35:54.804440 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:35:56.097804 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:35:56.104825 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:35:56.127205 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:35:56.166981 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:35:56.259001 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:35:56.280926 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:35:56.320643 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:35:56.915169 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:35:56.968687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:56.980112 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:35:57.041442 tst cs_paging_gprs_active.py: using LAC 19289 05:35:57.172079 tst cs_paging_gprs_active.py: using RAC 164 05:35:57.295738 tst cs_paging_gprs_active.py: using CellId 19289 05:35:57.418999 tst cs_paging_gprs_active.py: using BVCI 19290 05:35:57.535542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.546842 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.557813 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.569627 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.580809 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.592054 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.603462 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.614746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:35:57.626231 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.746574 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:35:57.869082 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:35:58.096341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:58.435539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Launched 05:35:58.728193 run iperf3-srv_10.42.42.10(pid=29382): Launched 05:35:58.853831 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:35:59.080199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:35:59.418192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29383): Launched 05:35:59.712633 run iperf3-srv_10.42.42.10(pid=29384): Launched 05:35:59.838508 tst cs_paging_gprs_active.py:38: start network... 05:36:00.063583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:00.585897 run create_hlr_db(pid=29385): Launched 05:36:00.721692 bus /gobi_6: Setting Powered False 05:36:01.787942 run create_hlr_db(pid=29385): Terminated: ok {rc=0} 05:36:02.246537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Launched 05:36:02.586549 run osmo-hlr_10.42.42.2(pid=29388): Launched 05:36:02.714543 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:03.299923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Launched 05:36:03.637248 run osmo-stp_10.42.42.5(pid=29391): Launched 05:36:03.764010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:04.345369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Launched 05:36:04.473483 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:04.759011 run patchelf(pid=29394): Launched 05:36:04.945571 run osmo-stp_10.42.42.5(pid=29391): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] 05:36:05.086821 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-09_05:36:03.574017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:05.230916 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221209053603772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053603772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053603772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053603773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053603773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053603773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053603773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:05.374199 run osmo-stp_10.42.42.5(pid=29391): stdout: | (launched: 2022-12-09_05:36:03.574017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:05.511220 run osmo-stp_10.42.42.5(pid=29391): stderr: | 20221209053603772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053603772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053603772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053603773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053603773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053603773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053603773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:05.673905 run patchelf(pid=29394): Terminating (SIGINT) 05:36:05.861800 run patchelf(pid=29394): Terminated: ok {rc=0} 05:36:05.997257 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:36:06.007289 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 05:36:06.035898 run osmo-hlr_10.42.42.2(pid=29388): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29388)] 05:36:06.086186 run osmo-hlr_10.42.42.2(pid=29388): stdout: | (launched: 2022-12-09_05:36:02.523255) 05:36:06.138281 run osmo-hlr_10.42.42.2(pid=29388): stderr: | 20221209053602729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053602729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053602729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053602729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053602729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053602729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053602741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053602750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053602750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053602750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:06.190634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Terminating (SIGTERM) 05:36:06.233198 run iperf3-srv_10.42.42.10(pid=29382): Terminating (SIGTERM) 05:36:06.275378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29383): Terminating (SIGTERM) 05:36:06.317554 run iperf3-srv_10.42.42.10(pid=29384): Terminating (SIGTERM) 05:36:06.359643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminating (SIGTERM) 05:36:06.401950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminating (SIGTERM) 05:36:06.444123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Terminating (SIGTERM) 05:36:06.486391 --- ParallelTerminationStrategy: PID 29381 died... 05:36:06.506584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Terminated: ok {rc=0} 05:36:06.553125 --- ParallelTerminationStrategy: PID 29382 died... 05:36:06.572698 run iperf3-srv_10.42.42.10(pid=29382): Terminated {rc=256} 05:36:06.618692 --- ParallelTerminationStrategy: PID 29383 died... 05:36:06.638221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29383): Terminated: ok {rc=0} 05:36:06.684200 --- ParallelTerminationStrategy: PID 29384 died... 05:36:06.703722 run iperf3-srv_10.42.42.10(pid=29384): Terminated {rc=256} 05:36:06.749660 --- ParallelTerminationStrategy: PID 29387 died... 05:36:06.769303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29387): Terminated: ok {rc=0} 05:36:06.815300 --- ParallelTerminationStrategy: PID 29390 died... 05:36:06.834989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29390): Terminated: ok {rc=0} 05:36:06.881399 --- ParallelTerminationStrategy: PID 29393 died... 05:36:06.901020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29393): Terminated: ok {rc=0} 05:36:06.989163 bus /gobi_0: Setting Powered False 05:36:08.088889 bus /gobi_0: Setting Powered False 05:36:09.206440 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:36:10.355502 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.367297 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:10.429214 tst iperf3.py: using LAC 19290 05:36:10.554312 tst iperf3.py: using RAC 165 05:36:10.677400 tst iperf3.py: using CellId 19290 05:36:10.800743 tst iperf3.py: using BVCI 19291 05:36:10.916392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.927623 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.938665 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.950421 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.962024 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.973653 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.985439 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:10.996746 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:11.008352 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:11.124497 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:11.336895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:11.653532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29395): Launched 05:36:11.928209 run iperf3-srv_10.42.42.10(pid=29396): Launched 05:36:12.046233 tst iperf3.py:8: start network... 05:36:12.256627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:12.742486 run create_hlr_db(pid=29397): Launched 05:36:12.861769 bus /gobi_6: Setting Powered False 05:36:13.923866 run create_hlr_db(pid=29397): Terminated: ok {rc=0} 05:36:14.382755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Launched 05:36:14.720345 run osmo-hlr_10.42.42.2(pid=29400): Launched 05:36:14.847597 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:15.431026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Launched 05:36:15.767682 run osmo-stp_10.42.42.5(pid=29403): Launched 05:36:16.023845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:16.665949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Launched 05:36:16.796561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:17.086523 run patchelf(pid=29406): Launched 05:36:17.287813 run osmo-stp_10.42.42.5(pid=29403): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] 05:36:17.430339 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-09_05:36:15.704695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:17.573555 run osmo-stp_10.42.42.5(pid=29403): stderr: | 20221209053615915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053615915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053615915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053615915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053615916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053615916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053615916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:17.716808 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-09_05:36:15.704695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:17.854677 run osmo-stp_10.42.42.5(pid=29403): stderr: | 20221209053615915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053615915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053615915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053615915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053615916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053615916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053615916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:18.017888 run patchelf(pid=29406): Terminating (SIGINT) 05:36:18.205334 run patchelf(pid=29406): Terminated: ok {rc=0} 05:36:18.340761 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 05:36:18.351045 tst iperf3.py:8: Test FAILED (8.0 sec) 05:36:18.379814 run osmo-hlr_10.42.42.2(pid=29400): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29400)] 05:36:18.430770 run osmo-hlr_10.42.42.2(pid=29400): stdout: | (launched: 2022-12-09_05:36:14.657550) 05:36:18.483274 run osmo-hlr_10.42.42.2(pid=29400): stderr: | 20221209053614860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053614860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053614860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053614860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053614860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053614860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053614872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053614883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053614884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053614884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:18.536213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29395): Terminating (SIGTERM) 05:36:18.578646 run iperf3-srv_10.42.42.10(pid=29396): Terminating (SIGTERM) 05:36:18.621076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminating (SIGTERM) 05:36:18.663536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminating (SIGTERM) 05:36:18.706279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Terminating (SIGTERM) 05:36:18.748806 --- ParallelTerminationStrategy: PID 29395 died... 05:36:18.769260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29395): Terminated: ok {rc=0} 05:36:18.816285 --- ParallelTerminationStrategy: PID 29396 died... 05:36:18.836239 run iperf3-srv_10.42.42.10(pid=29396): Terminated {rc=256} 05:36:18.882895 --- ParallelTerminationStrategy: PID 29399 died... 05:36:18.902596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminated: ok {rc=0} 05:36:18.949647 --- ParallelTerminationStrategy: PID 29402 died... 05:36:18.969597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminated: ok {rc=0} 05:36:19.016341 --- ParallelTerminationStrategy: PID 29405 died... 05:36:19.036308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Terminated: ok {rc=0} 05:36:19.124156 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:36:20.272618 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.284318 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:20.342499 tst iperf3m4.py: using LAC 19291 05:36:20.466028 tst iperf3m4.py: using RAC 166 05:36:20.590791 tst iperf3m4.py: using CellId 19291 05:36:20.712916 tst iperf3m4.py: using BVCI 19292 05:36:20.828832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.839726 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.850465 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.861471 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.872277 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.883169 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.894342 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.905134 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:20.916173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:21.038424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:21.160892 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:21.283273 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:21.405984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:36:21.633128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:21.972458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29407): Launched 05:36:22.267294 run iperf3-srv_10.42.42.10(pid=29408): Launched 05:36:22.393095 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:36:22.618671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:22.956451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29409): Launched 05:36:23.250797 run iperf3-srv_10.42.42.10(pid=29410): Launched 05:36:23.376917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:36:23.602604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:23.940414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29411): Launched 05:36:24.233705 run iperf3-srv_10.42.42.10(pid=29412): Launched 05:36:24.359776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:36:24.585482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:24.923801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29413): Launched 05:36:25.217097 run iperf3-srv_10.42.42.10(pid=29414): Launched 05:36:25.346009 tst iperf3m4.py:8: start network... 05:36:25.571166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:26.092243 run create_hlr_db(pid=29415): Launched 05:36:26.228638 bus /gobi_6: Setting Powered False 05:36:27.291075 run create_hlr_db(pid=29415): Terminated: ok {rc=0} 05:36:27.738822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29417): Launched 05:36:28.053024 run osmo-hlr_10.42.42.2(pid=29418): Launched 05:36:28.173352 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:28.728442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29420): Launched 05:36:29.043077 run osmo-stp_10.42.42.5(pid=29421): Launched 05:36:29.162103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:29.702996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29423): Launched 05:36:29.823033 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:30.088545 run patchelf(pid=29424): Launched 05:36:30.262564 run osmo-stp_10.42.42.5(pid=29421): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29421)] 05:36:30.395065 run osmo-stp_10.42.42.5(pid=29421): stdout: | (launched: 2022-12-09_05:36:28.983476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:30.528793 run osmo-stp_10.42.42.5(pid=29421): stderr: | 20221209053629158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053629158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053629158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053629159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053629159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053629159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053629159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:30.662524 run osmo-stp_10.42.42.5(pid=29421): stdout: | (launched: 2022-12-09_05:36:28.983476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:30.791297 run osmo-stp_10.42.42.5(pid=29421): stderr: | 20221209053629158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053629158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053629158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053629159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053629159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053629159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053629159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:30.965379 run patchelf(pid=29424): Terminating (SIGINT) 05:36:31.144891 run patchelf(pid=29424): Terminated: ok {rc=0} 05:36:31.274968 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29421): Process ended prematurely: osmo-stp_10.42.42.5(pid=29421) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29421)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:36:31.285638 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:36:31.317062 run osmo-hlr_10.42.42.2(pid=29418): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29418)] 05:36:31.367734 run osmo-hlr_10.42.42.2(pid=29418): stdout: | (launched: 2022-12-09_05:36:27.993810) 05:36:31.420105 run osmo-hlr_10.42.42.2(pid=29418): stderr: | 20221209053628174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053628175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053628175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053628175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053628175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053628175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053628187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053628197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053628197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053628197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:31.473202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29407): Terminating (SIGTERM) 05:36:31.516335 run iperf3-srv_10.42.42.10(pid=29408): Terminating (SIGTERM) 05:36:31.562578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29409): Terminating (SIGTERM) 05:36:31.606498 run iperf3-srv_10.42.42.10(pid=29410): Terminating (SIGTERM) 05:36:31.652697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29411): Terminating (SIGTERM) 05:36:31.696496 run iperf3-srv_10.42.42.10(pid=29412): Terminating (SIGTERM) 05:36:31.742515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29413): Terminating (SIGTERM) 05:36:31.786206 run iperf3-srv_10.42.42.10(pid=29414): Terminating (SIGTERM) 05:36:31.832166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29417): Terminating (SIGTERM) 05:36:31.875397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29420): Terminating (SIGTERM) 05:36:31.918582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29423): Terminating (SIGTERM) 05:36:31.961538 --- ParallelTerminationStrategy: PID 29407 died... 05:36:31.981547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29407): Terminated: ok {rc=0} 05:36:32.029707 --- ParallelTerminationStrategy: PID 29408 died... 05:36:32.049574 run iperf3-srv_10.42.42.10(pid=29408): Terminated {rc=256} 05:36:32.097222 --- ParallelTerminationStrategy: PID 29409 died... 05:36:32.117308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29409): Terminated: ok {rc=0} 05:36:32.165214 --- ParallelTerminationStrategy: PID 29410 died... 05:36:32.184941 run iperf3-srv_10.42.42.10(pid=29410): Terminated {rc=256} 05:36:32.232560 --- ParallelTerminationStrategy: PID 29411 died... 05:36:32.252248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29411): Terminated: ok {rc=0} 05:36:32.300138 --- ParallelTerminationStrategy: PID 29412 died... 05:36:32.320499 run iperf3-srv_10.42.42.10(pid=29412): Terminated {rc=256} 05:36:32.366363 --- ParallelTerminationStrategy: PID 29413 died... 05:36:32.385091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29413): Terminated: ok {rc=0} 05:36:32.430671 --- ParallelTerminationStrategy: PID 29414 died... 05:36:32.449487 run iperf3-srv_10.42.42.10(pid=29414): Terminated {rc=256} 05:36:32.494974 --- ParallelTerminationStrategy: PID 29417 died... 05:36:32.513896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29417): Terminated: ok {rc=0} 05:36:32.559816 --- ParallelTerminationStrategy: PID 29420 died... 05:36:32.578635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29420): Terminated: ok {rc=0} 05:36:32.624594 --- ParallelTerminationStrategy: PID 29423 died... 05:36:32.643426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29423): Terminated: ok {rc=0} 05:36:32.732124 bus /gobi_4: Setting Powered False 05:36:33.832042 bus /gobi_4: Setting Powered False 05:36:34.949071 bus /gobi_1: Setting Powered False 05:36:36.048360 bus /gobi_1: Setting Powered False 05:36:37.163221 bus /gobi_0: Setting Powered False 05:36:38.262824 bus /gobi_0: Setting Powered False 05:36:39.377624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:36:40.478288 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:40.489936 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:40.547666 tst ping.py: using LAC 19292 05:36:40.669428 tst ping.py: using RAC 167 05:36:40.801826 tst ping.py: using CellId 19292 05:36:40.923613 tst ping.py: using BVCI 19293 05:36:41.034741 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.045787 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.056595 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.067763 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.078801 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.089754 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.100928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:41.112305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:41.228636 tst ping.py:19: start network... 05:36:41.435520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:41.913369 run create_hlr_db(pid=29425): Launched 05:36:42.030560 bus /gobi_6: Setting Powered False 05:36:43.092197 run create_hlr_db(pid=29425): Terminated: ok {rc=0} 05:36:43.525498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Launched 05:36:43.835708 run osmo-hlr_10.42.42.2(pid=29428): Launched 05:36:43.953161 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:44.505459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Launched 05:36:44.816318 run osmo-stp_10.42.42.5(pid=29431): Launched 05:36:44.934279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:45.466471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29433): Launched 05:36:45.584700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:45.853695 run patchelf(pid=29434): Launched 05:36:46.055831 run osmo-stp_10.42.42.5(pid=29431): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] 05:36:46.200198 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-09_05:36:44.757661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:46.346937 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221209053644929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053644929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053644929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053644929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053644932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053644932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053644932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:46.491757 run osmo-stp_10.42.42.5(pid=29431): stdout: | (launched: 2022-12-09_05:36:44.757661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:46.633057 run osmo-stp_10.42.42.5(pid=29431): stderr: | 20221209053644929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053644929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053644929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053644929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053644932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053644932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053644932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:46.800100 run patchelf(pid=29434): Terminating (SIGINT) 05:36:46.989514 run patchelf(pid=29434): Terminated: ok {rc=0} 05:36:47.126744 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 05:36:47.136758 tst ping.py:22: Test FAILED (6.7 sec) 05:36:47.165976 run osmo-hlr_10.42.42.2(pid=29428): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29428)] 05:36:47.216809 run osmo-hlr_10.42.42.2(pid=29428): stdout: | (launched: 2022-12-09_05:36:43.776858) 05:36:47.269774 run osmo-hlr_10.42.42.2(pid=29428): stderr: | 20221209053643957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053643957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053643957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053643957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053643957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053643957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053643969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053643977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053643978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053643978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:47.322934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminating (SIGTERM) 05:36:47.365377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminating (SIGTERM) 05:36:47.407718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29433): Terminating (SIGTERM) 05:36:47.450582 --- ParallelTerminationStrategy: PID 29427 died... 05:36:47.471111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29427): Terminated: ok {rc=0} 05:36:47.518130 --- ParallelTerminationStrategy: PID 29430 died... 05:36:47.538403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29430): Terminated: ok {rc=0} 05:36:47.585239 --- ParallelTerminationStrategy: PID 29433 died... 05:36:47.605212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29433): Terminated: ok {rc=0} 05:36:47.693931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:36:48.781215 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:48.793430 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:36:48.853993 tst ping_idle_ping.py: using LAC 19293 05:36:48.983926 tst ping_idle_ping.py: using RAC 168 05:36:49.113944 tst ping_idle_ping.py: using CellId 19293 05:36:49.242405 tst ping_idle_ping.py: using BVCI 19294 05:36:49.361934 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.373521 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.384902 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.396322 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.407653 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.418891 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.430461 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:36:49.441821 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:36:49.558354 tst ping_idle_ping.py:24: start network... 05:36:49.766465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:36:50.248796 run create_hlr_db(pid=29435): Launched 05:36:50.367156 bus /gobi_6: Setting Powered False 05:36:51.428145 run create_hlr_db(pid=29435): Terminated: ok {rc=0} 05:36:51.862305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29437): Launched 05:36:52.173625 run osmo-hlr_10.42.42.2(pid=29438): Launched 05:36:52.291451 run osmo-stp_10.42.42.5: Starting osmo-stp 05:36:52.822058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29440): Launched 05:36:53.131891 run osmo-stp_10.42.42.5(pid=29441): Launched 05:36:53.249446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:36:53.783350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29443): Launched 05:36:53.902259 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:36:54.164920 run patchelf(pid=29444): Launched 05:36:54.337121 run osmo-stp_10.42.42.5(pid=29441): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29441)] 05:36:54.467917 run osmo-stp_10.42.42.5(pid=29441): stdout: | (launched: 2022-12-09_05:36:53.073197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:54.599893 run osmo-stp_10.42.42.5(pid=29441): stderr: | 20221209053653246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053653246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053653247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053653247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053653247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053653248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053653248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:54.731714 run osmo-stp_10.42.42.5(pid=29441): stdout: | (launched: 2022-12-09_05:36:53.073197) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:36:54.857721 run osmo-stp_10.42.42.5(pid=29441): stderr: | 20221209053653246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053653246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053653247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053653247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053653247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053653248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053653248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:36:55.007249 run patchelf(pid=29444): Terminating (SIGINT) 05:36:55.179784 run patchelf(pid=29444): Terminated: ok {rc=0} 05:36:55.304711 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29441): Process ended prematurely: osmo-stp_10.42.42.5(pid=29441) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29441)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:36:55.313711 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:36:55.341098 run osmo-hlr_10.42.42.2(pid=29438): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29438)] 05:36:55.389571 run osmo-hlr_10.42.42.2(pid=29438): stdout: | (launched: 2022-12-09_05:36:52.114995) 05:36:55.439692 run osmo-hlr_10.42.42.2(pid=29438): stderr: | 20221209053652295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053652295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053652295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053652295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053652295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053652295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053652307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053652315 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053652316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053652316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:36:55.490302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29437): Terminating (SIGTERM) 05:36:55.531284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29440): Terminating (SIGTERM) 05:36:55.571988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29443): Terminating (SIGTERM) 05:36:55.612889 --- ParallelTerminationStrategy: PID 29437 died... 05:36:55.632254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29437): Terminated: ok {rc=0} 05:36:55.677865 --- ParallelTerminationStrategy: PID 29440 died... 05:36:55.696668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29440): Terminated: ok {rc=0} 05:36:55.742295 --- ParallelTerminationStrategy: PID 29443 died... 05:36:55.761294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29443): Terminated: ok {rc=0} 05:36:55.846574 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:36:57.140059 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:36:57.147106 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:36:57.169361 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:36:57.209245 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:36:57.304763 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:36:57.326414 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:36:57.365766 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:36:57.956693 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:36:58.010278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.021829 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:36:58.078886 tst cs_paging_gprs_active.py: using LAC 19294 05:36:58.210642 tst cs_paging_gprs_active.py: using RAC 169 05:36:58.340896 tst cs_paging_gprs_active.py: using CellId 19294 05:36:58.470620 tst cs_paging_gprs_active.py: using BVCI 19295 05:36:58.594857 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.606237 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.617398 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.628499 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.639608 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.650843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.662281 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.673477 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:36:58.684861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:58.805476 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:36:58.927888 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:36:59.155275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:36:59.494129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29448): Launched 05:36:59.788558 run iperf3-srv_10.42.42.10(pid=29449): Launched 05:36:59.914356 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:37:00.139443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:00.477856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29450): Launched 05:37:00.772112 run iperf3-srv_10.42.42.10(pid=29451): Launched 05:37:00.899571 tst cs_paging_gprs_active.py:38: start network... 05:37:01.129986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:01.665766 run create_hlr_db(pid=29452): Launched 05:37:01.834482 bus /gobi_6: Setting Powered False 05:37:02.899819 run create_hlr_db(pid=29452): Terminated: ok {rc=0} 05:37:03.348320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Launched 05:37:03.664838 run osmo-hlr_10.42.42.2(pid=29455): Launched 05:37:03.786517 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:04.331544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Launched 05:37:04.647666 run osmo-stp_10.42.42.5(pid=29458): Launched 05:37:04.767040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:05.309518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29460): Launched 05:37:05.430200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:05.698191 run patchelf(pid=29461): Launched 05:37:05.873376 run osmo-stp_10.42.42.5(pid=29458): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] 05:37:06.006684 run osmo-stp_10.42.42.5(pid=29458): stdout: | (launched: 2022-12-09_05:37:04.587819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:06.141666 run osmo-stp_10.42.42.5(pid=29458): stderr: | 20221209053704763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053704763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053704763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053704764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053704766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053704766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053704766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:06.275866 run osmo-stp_10.42.42.5(pid=29458): stdout: | (launched: 2022-12-09_05:37:04.587819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:06.404459 run osmo-stp_10.42.42.5(pid=29458): stderr: | 20221209053704763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053704763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053704763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053704764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053704766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053704766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053704766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:06.557205 run patchelf(pid=29461): Terminating (SIGINT) 05:37:06.733156 run patchelf(pid=29461): Terminated: ok {rc=0} 05:37:06.860426 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29458): Process ended prematurely: osmo-stp_10.42.42.5(pid=29458) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:37:06.870100 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:37:06.897888 run osmo-hlr_10.42.42.2(pid=29455): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29455)] 05:37:06.946896 run osmo-hlr_10.42.42.2(pid=29455): stdout: | (launched: 2022-12-09_05:37:03.605384) 05:37:06.997428 run osmo-hlr_10.42.42.2(pid=29455): stderr: | 20221209053703785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053703785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053703785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053703786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053703786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053703786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053703797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053703806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053703806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053703806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:07.048583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29448): Terminating (SIGTERM) 05:37:07.089581 run iperf3-srv_10.42.42.10(pid=29449): Terminating (SIGTERM) 05:37:07.130419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29450): Terminating (SIGTERM) 05:37:07.171398 run iperf3-srv_10.42.42.10(pid=29451): Terminating (SIGTERM) 05:37:07.211898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Terminating (SIGTERM) 05:37:07.252437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Terminating (SIGTERM) 05:37:07.293674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29460): Terminating (SIGTERM) 05:37:07.334878 --- ParallelTerminationStrategy: PID 29448 died... 05:37:07.354121 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29448): Terminated: ok {rc=0} 05:37:07.399351 --- ParallelTerminationStrategy: PID 29449 died... 05:37:07.418208 run iperf3-srv_10.42.42.10(pid=29449): Terminated {rc=256} 05:37:07.462814 --- ParallelTerminationStrategy: PID 29450 died... 05:37:07.481739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29450): Terminated: ok {rc=0} 05:37:07.526621 --- ParallelTerminationStrategy: PID 29451 died... 05:37:07.545672 run iperf3-srv_10.42.42.10(pid=29451): Terminated {rc=256} 05:37:07.590816 --- ParallelTerminationStrategy: PID 29454 died... 05:37:07.609966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Terminated: ok {rc=0} 05:37:07.654911 --- ParallelTerminationStrategy: PID 29457 died... 05:37:07.673689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Terminated: ok {rc=0} 05:37:07.718397 --- ParallelTerminationStrategy: PID 29460 died... 05:37:07.737320 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29460): Terminated: ok {rc=0} 05:37:07.824316 bus /gobi_0: Setting Powered False 05:37:08.924256 bus /gobi_0: Setting Powered False 05:37:10.040838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:37:11.189734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.201546 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:11.261687 tst iperf3.py: using LAC 19295 05:37:11.389454 tst iperf3.py: using RAC 170 05:37:11.511829 tst iperf3.py: using CellId 19295 05:37:11.635172 tst iperf3.py: using BVCI 19296 05:37:11.750861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.761984 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.772669 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.783697 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.794758 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.805808 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.816747 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.827817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:11.839256 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:11.960847 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:37:12.189194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:12.529269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Launched 05:37:12.824925 run iperf3-srv_10.42.42.10(pid=29463): Launched 05:37:12.951292 tst iperf3.py:8: start network... 05:37:13.178201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:13.701148 run create_hlr_db(pid=29464): Launched 05:37:13.836675 bus /gobi_6: Setting Powered False 05:37:14.902302 run create_hlr_db(pid=29464): Terminated: ok {rc=0} 05:37:15.368327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Launched 05:37:15.705268 run osmo-hlr_10.42.42.2(pid=29467): Launched 05:37:15.841504 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:16.534420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Launched 05:37:16.886980 run osmo-stp_10.42.42.5(pid=29470): Launched 05:37:17.158843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:17.746969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Launched 05:37:17.867351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:18.135042 run patchelf(pid=29473): Launched 05:37:18.310565 run osmo-stp_10.42.42.5(pid=29470): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] 05:37:18.443765 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-09_05:37:16.822127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:18.578375 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221209053717119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053717119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053717119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053717121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053717122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053717122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053717122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:18.714004 run osmo-stp_10.42.42.5(pid=29470): stdout: | (launched: 2022-12-09_05:37:16.822127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:18.843759 run osmo-stp_10.42.42.5(pid=29470): stderr: | 20221209053717119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053717119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053717119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053717121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053717122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053717122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053717122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:18.997677 run patchelf(pid=29473): Terminating (SIGINT) 05:37:19.174430 run patchelf(pid=29473): Terminated: ok {rc=0} 05:37:19.302107 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 05:37:19.311625 tst iperf3.py:8: Test FAILED (8.2 sec) 05:37:19.339491 run osmo-hlr_10.42.42.2(pid=29467): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29467)] 05:37:19.388153 run osmo-hlr_10.42.42.2(pid=29467): stdout: | (launched: 2022-12-09_05:37:15.641761) 05:37:19.439009 run osmo-hlr_10.42.42.2(pid=29467): stderr: | 20221209053715887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053715887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053715887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053715887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053715887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053715887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053715912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053715928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053715928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053715928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:19.490014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminating (SIGTERM) 05:37:19.530926 run iperf3-srv_10.42.42.10(pid=29463): Terminating (SIGTERM) 05:37:19.571715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminating (SIGTERM) 05:37:19.612709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminating (SIGTERM) 05:37:19.653720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminating (SIGTERM) 05:37:19.695163 --- ParallelTerminationStrategy: PID 29462 died... 05:37:19.714674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29462): Terminated: ok {rc=0} 05:37:19.760281 --- ParallelTerminationStrategy: PID 29463 died... 05:37:19.779364 run iperf3-srv_10.42.42.10(pid=29463): Terminated {rc=256} 05:37:19.824591 --- ParallelTerminationStrategy: PID 29466 died... 05:37:19.843610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29466): Terminated: ok {rc=0} 05:37:19.889226 --- ParallelTerminationStrategy: PID 29469 died... 05:37:19.908044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29469): Terminated: ok {rc=0} 05:37:19.953585 --- ParallelTerminationStrategy: PID 29472 died... 05:37:19.972709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29472): Terminated: ok {rc=0} 05:37:20.060166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:37:21.210491 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.222394 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:21.279541 tst iperf3m4.py: using LAC 19296 05:37:21.408296 tst iperf3m4.py: using RAC 171 05:37:21.530372 tst iperf3m4.py: using CellId 19296 05:37:21.653262 tst iperf3m4.py: using BVCI 19297 05:37:21.768115 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.779338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.790160 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.801441 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.812472 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.823679 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.834895 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.845867 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:21.857984 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:21.982409 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:22.102450 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:22.224051 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:22.346933 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:37:22.573924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:22.912352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Launched 05:37:23.207767 run iperf3-srv_10.42.42.10(pid=29475): Launched 05:37:23.334191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:37:23.559593 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:23.897669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Launched 05:37:24.190466 run iperf3-srv_10.42.42.10(pid=29477): Launched 05:37:24.316413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:37:24.541326 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:24.877681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Launched 05:37:25.170772 run iperf3-srv_10.42.42.10(pid=29479): Launched 05:37:25.298868 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:37:25.524092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:37:25.862086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Launched 05:37:26.156566 run iperf3-srv_10.42.42.10(pid=29481): Launched 05:37:26.282237 tst iperf3m4.py:8: start network... 05:37:26.507178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:27.027496 run create_hlr_db(pid=29482): Launched 05:37:27.162684 bus /gobi_6: Setting Powered False 05:37:28.228572 run create_hlr_db(pid=29482): Terminated: ok {rc=0} 05:37:28.675602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Launched 05:37:28.991289 run osmo-hlr_10.42.42.2(pid=29485): Launched 05:37:29.111554 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:29.672153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Launched 05:37:29.989201 run osmo-stp_10.42.42.5(pid=29488): Launched 05:37:30.109103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:30.651662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Launched 05:37:30.772731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:31.065375 run patchelf(pid=29491): Launched 05:37:31.316282 run osmo-stp_10.42.42.5(pid=29488): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] 05:37:31.455740 run osmo-stp_10.42.42.5(pid=29488): stdout: | (launched: 2022-12-09_05:37:29.929338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:31.595663 run osmo-stp_10.42.42.5(pid=29488): stderr: | 20221209053730107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053730107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053730107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053730107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053730108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053730108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053730108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:31.733700 run osmo-stp_10.42.42.5(pid=29488): stdout: | (launched: 2022-12-09_05:37:29.929338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:31.867084 run osmo-stp_10.42.42.5(pid=29488): stderr: | 20221209053730107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053730107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053730107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053730107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053730108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053730108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053730108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:32.024190 run patchelf(pid=29491): Terminating (SIGINT) 05:37:32.204669 run patchelf(pid=29491): Terminated: ok {rc=0} 05:37:32.334624 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29488): Process ended prematurely: osmo-stp_10.42.42.5(pid=29488) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:37:32.344890 tst iperf3m4.py:8: Test FAILED (11.2 sec) 05:37:32.374796 run osmo-hlr_10.42.42.2(pid=29485): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29485)] 05:37:32.424376 run osmo-hlr_10.42.42.2(pid=29485): stdout: | (launched: 2022-12-09_05:37:28.931879) 05:37:32.475574 run osmo-hlr_10.42.42.2(pid=29485): stderr: | 20221209053729113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053729113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053729113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053729113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053729114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053729114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053729126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053729134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053729134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053729134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:32.526970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Terminating (SIGTERM) 05:37:32.568732 run iperf3-srv_10.42.42.10(pid=29475): Terminating (SIGTERM) 05:37:32.610538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Terminating (SIGTERM) 05:37:32.652270 run iperf3-srv_10.42.42.10(pid=29477): Terminating (SIGTERM) 05:37:32.693828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Terminating (SIGTERM) 05:37:32.735423 run iperf3-srv_10.42.42.10(pid=29479): Terminating (SIGTERM) 05:37:32.777032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Terminating (SIGTERM) 05:37:32.819003 run iperf3-srv_10.42.42.10(pid=29481): Terminating (SIGTERM) 05:37:32.860329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Terminating (SIGTERM) 05:37:32.901926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Terminating (SIGTERM) 05:37:32.942865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Terminating (SIGTERM) 05:37:32.984700 --- ParallelTerminationStrategy: PID 29474 died... 05:37:33.004331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Terminated: ok {rc=0} 05:37:33.049975 --- ParallelTerminationStrategy: PID 29475 died... 05:37:33.069169 run iperf3-srv_10.42.42.10(pid=29475): Terminated {rc=256} 05:37:33.114351 --- ParallelTerminationStrategy: PID 29476 died... 05:37:33.133361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Terminated: ok {rc=0} 05:37:33.178816 --- ParallelTerminationStrategy: PID 29477 died... 05:37:33.197922 run iperf3-srv_10.42.42.10(pid=29477): Terminated {rc=256} 05:37:33.243141 --- ParallelTerminationStrategy: PID 29478 died... 05:37:33.262222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29478): Terminated: ok {rc=0} 05:37:33.307701 --- ParallelTerminationStrategy: PID 29479 died... 05:37:33.326872 run iperf3-srv_10.42.42.10(pid=29479): Terminated {rc=256} 05:37:33.371974 --- ParallelTerminationStrategy: PID 29480 died... 05:37:33.390991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29480): Terminated: ok {rc=0} 05:37:33.435907 --- ParallelTerminationStrategy: PID 29481 died... 05:37:33.455099 run iperf3-srv_10.42.42.10(pid=29481): Terminated {rc=256} 05:37:33.500023 --- ParallelTerminationStrategy: PID 29484 died... 05:37:33.519171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29484): Terminated: ok {rc=0} 05:37:33.564274 --- ParallelTerminationStrategy: PID 29487 died... 05:37:33.583258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29487): Terminated: ok {rc=0} 05:37:33.628672 --- ParallelTerminationStrategy: PID 29490 died... 05:37:33.647672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29490): Terminated: ok {rc=0} 05:37:33.735242 bus /gobi_4: Setting Powered False 05:37:34.836317 bus /gobi_4: Setting Powered False 05:37:35.951665 bus /gobi_1: Setting Powered False 05:37:37.050789 bus /gobi_1: Setting Powered False 05:37:38.164731 bus /gobi_0: Setting Powered False 05:37:39.263848 bus /gobi_0: Setting Powered False 05:37:40.380006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:37:41.482607 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:41.494988 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:41.555052 tst ping.py: using LAC 19297 05:37:41.688030 tst ping.py: using RAC 172 05:37:41.817524 tst ping.py: using CellId 19297 05:37:41.948435 tst ping.py: using BVCI 19298 05:37:42.068247 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.079899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.091233 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.102721 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.114660 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.126251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.138101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:42.149636 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:42.270876 tst ping.py:19: start network... 05:37:42.493941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:43.005464 run create_hlr_db(pid=29492): Launched 05:37:43.138015 bus /gobi_6: Setting Powered False 05:37:44.202339 run create_hlr_db(pid=29492): Terminated: ok {rc=0} 05:37:44.644719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Launched 05:37:44.955183 run osmo-hlr_10.42.42.2(pid=29495): Launched 05:37:45.073173 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:45.622645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Launched 05:37:45.944043 run osmo-stp_10.42.42.5(pid=29498): Launched 05:37:46.205350 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:47.010411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29500): Launched 05:37:47.142048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:47.410935 run patchelf(pid=29501): Launched 05:37:47.583357 run osmo-stp_10.42.42.5(pid=29498): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] 05:37:47.713666 run osmo-stp_10.42.42.5(pid=29498): stdout: | (launched: 2022-12-09_05:37:45.876445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:47.845759 run osmo-stp_10.42.42.5(pid=29498): stderr: | 20221209053746237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053746238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053746240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053746242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053746244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053746245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053746246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:47.978020 run osmo-stp_10.42.42.5(pid=29498): stdout: | (launched: 2022-12-09_05:37:45.876445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:48.103992 run osmo-stp_10.42.42.5(pid=29498): stderr: | 20221209053746237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053746238 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053746240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053746242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053746244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053746245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053746246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:48.252702 run patchelf(pid=29501): Terminating (SIGINT) 05:37:48.425559 run patchelf(pid=29501): Terminated: ok {rc=0} 05:37:48.549808 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29498): Process ended prematurely: osmo-stp_10.42.42.5(pid=29498) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 05:37:48.558895 tst ping.py:22: Test FAILED (7.1 sec) 05:37:48.586322 run osmo-hlr_10.42.42.2(pid=29495): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29495)] 05:37:48.634825 run osmo-hlr_10.42.42.2(pid=29495): stdout: | (launched: 2022-12-09_05:37:44.896788) 05:37:48.685065 run osmo-hlr_10.42.42.2(pid=29495): stderr: | 20221209053745075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053745076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053745076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053745076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053745076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053745076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053745088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053745096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053745097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053745097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:48.735504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Terminating (SIGTERM) 05:37:48.776296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Terminating (SIGTERM) 05:37:48.817069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29500): Terminating (SIGTERM) 05:37:48.858196 --- ParallelTerminationStrategy: PID 29494 died... 05:37:48.877437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29494): Terminated: ok {rc=0} 05:37:48.922301 --- ParallelTerminationStrategy: PID 29497 died... 05:37:48.941166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29497): Terminated: ok {rc=0} 05:37:48.985810 --- ParallelTerminationStrategy: PID 29500 died... 05:37:49.004548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29500): Terminated: ok {rc=0} 05:37:49.089734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:37:50.178825 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.191308 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:37:50.251603 tst ping_idle_ping.py: using LAC 19298 05:37:50.383512 tst ping_idle_ping.py: using RAC 173 05:37:50.513267 tst ping_idle_ping.py: using CellId 19298 05:37:50.644460 tst ping_idle_ping.py: using BVCI 19299 05:37:50.766411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.778427 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.789895 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.801357 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.812642 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.824024 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.836101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:37:50.847739 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:37:50.968335 tst ping_idle_ping.py:24: start network... 05:37:51.191587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:37:51.711050 run create_hlr_db(pid=29502): Launched 05:37:51.844363 bus /gobi_6: Setting Powered False 05:37:52.910065 run create_hlr_db(pid=29502): Terminated: ok {rc=0} 05:37:53.352932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Launched 05:37:53.664177 run osmo-hlr_10.42.42.2(pid=29505): Launched 05:37:53.781929 run osmo-stp_10.42.42.5: Starting osmo-stp 05:37:54.335704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Launched 05:37:54.649066 run osmo-stp_10.42.42.5(pid=29508): Launched 05:37:54.767257 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:37:55.302766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Launched 05:37:55.421954 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:37:55.685560 run patchelf(pid=29511): Launched 05:37:55.858408 run osmo-stp_10.42.42.5(pid=29508): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] 05:37:55.989814 run osmo-stp_10.42.42.5(pid=29508): stdout: | (launched: 2022-12-09_05:37:54.589900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:56.123120 run osmo-stp_10.42.42.5(pid=29508): stderr: | 20221209053754764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053754764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053754764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053754765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053754765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053754765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053754765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:56.255758 run osmo-stp_10.42.42.5(pid=29508): stdout: | (launched: 2022-12-09_05:37:54.589900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:37:56.382971 run osmo-stp_10.42.42.5(pid=29508): stderr: | 20221209053754764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053754764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053754764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053754765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053754765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053754765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053754765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:37:56.533177 run patchelf(pid=29511): Terminating (SIGINT) 05:37:56.706848 run patchelf(pid=29511): Terminated: ok {rc=0} 05:37:56.832328 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29508): Process ended prematurely: osmo-stp_10.42.42.5(pid=29508) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:37:56.841615 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:37:56.869166 run osmo-hlr_10.42.42.2(pid=29505): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29505)] 05:37:56.917931 run osmo-hlr_10.42.42.2(pid=29505): stdout: | (launched: 2022-12-09_05:37:53.605297) 05:37:56.968495 run osmo-hlr_10.42.42.2(pid=29505): stderr: | 20221209053753785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053753785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053753785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053753785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053753785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053753785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053753803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053753813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053753813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053753813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:37:57.019603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Terminating (SIGTERM) 05:37:57.060495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Terminating (SIGTERM) 05:37:57.101276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Terminating (SIGTERM) 05:37:57.142398 --- ParallelTerminationStrategy: PID 29504 died... 05:37:57.161779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29504): Terminated: ok {rc=0} 05:37:57.207595 --- ParallelTerminationStrategy: PID 29507 died... 05:37:57.226625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29507): Terminated: ok {rc=0} 05:37:57.271766 --- ParallelTerminationStrategy: PID 29510 died... 05:37:57.290962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29510): Terminated: ok {rc=0} 05:37:57.378635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:37:58.674558 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:37:58.683121 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:37:58.705332 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:37:58.741206 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:37:58.794870 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:37:58.816465 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:37:58.852371 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:37:59.413366 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:37:59.418929 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:37:59.430868 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:37:59.488593 tst switch_tch_pdch.py: using LAC 19299 05:37:59.617008 tst switch_tch_pdch.py: using RAC 174 05:37:59.743505 tst switch_tch_pdch.py: using CellId 19299 05:37:59.876236 tst switch_tch_pdch.py: using BVCI 19300 05:37:59.995453 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.007265 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.019123 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.031029 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.042746 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.054475 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.066369 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:38:00.078133 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:38:00.196333 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:38:00.313427 tst switch_tch_pdch.py:51: start network... 05:38:00.519162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:01.024621 run create_hlr_db(pid=29515): Launched 05:38:01.216898 bus /gobi_6: Setting Powered False 05:38:02.316691 run create_hlr_db(pid=29515): Terminated: ok {rc=0} 05:38:02.912854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29617): Launched 05:38:03.289079 run osmo-hlr_10.42.42.2(pid=29663): Launched 05:38:03.553385 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:04.454879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29789): Launched 05:38:04.779001 run osmo-stp_10.42.42.5(pid=29790): Launched 05:38:05.016488 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:05.724121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29792): Launched 05:38:05.858179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:06.129962 run patchelf(pid=29793): Launched 05:38:06.320931 run osmo-stp_10.42.42.5(pid=29790): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29790)] 05:38:06.455121 run osmo-stp_10.42.42.5(pid=29790): stdout: | (launched: 2022-12-09_05:38:04.717260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:06.591141 run osmo-stp_10.42.42.5(pid=29790): stderr: | 20221209053805052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053805052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053805052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053805061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053805063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053805063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053805063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:06.727361 run osmo-stp_10.42.42.5(pid=29790): stdout: | (launched: 2022-12-09_05:38:04.717260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:06.857809 run osmo-stp_10.42.42.5(pid=29790): stderr: | 20221209053805052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053805052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053805052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053805061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053805063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053805063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053805063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:07.014710 run patchelf(pid=29793): Terminating (SIGINT) 05:38:07.193217 run patchelf(pid=29793): Terminated: ok {rc=0} 05:38:07.321799 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29790): Process ended prematurely: osmo-stp_10.42.42.5(pid=29790) [trial-2355↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29790)] [trial-2355↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:38:07.331725 tst switch_tch_pdch.py:54: Test FAILED (7.9 sec) 05:38:07.362385 run osmo-hlr_10.42.42.2(pid=29663): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29663)] 05:38:07.413868 run osmo-hlr_10.42.42.2(pid=29663): stdout: | (launched: 2022-12-09_05:38:03.221533) 05:38:07.466904 run osmo-hlr_10.42.42.2(pid=29663): stderr: | 20221209053803596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053803596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053803596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053803596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053803596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053803596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053803621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053803637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053803638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053803638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:07.520678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29617): Terminating (SIGTERM) 05:38:07.564740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29789): Terminating (SIGTERM) 05:38:07.610755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29792): Terminating (SIGTERM) 05:38:07.656039 --- ParallelTerminationStrategy: PID 29617 died... 05:38:07.676408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29617): Terminated: ok {rc=0} 05:38:07.726439 --- ParallelTerminationStrategy: PID 29789 died... 05:38:07.746492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29789): Terminated: ok {rc=0} 05:38:07.795350 --- ParallelTerminationStrategy: PID 29792 died... 05:38:07.815412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29792): Terminated: ok {rc=0} 05:38:07.905103 bus /gobi_0: Setting Powered False 05:38:09.004593 bus /gobi_0: Setting Powered False 05:38:10.128278 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:38:11.370458 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:11.377088 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:38:11.400083 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:38:11.439228 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:38:11.494178 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:38:11.517114 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:38:11.554965 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:38:12.105941 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:38:12.113617 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.125808 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:38:12.186312 tst switch_tch_pdch.py: using LAC 19300 05:38:12.310394 tst switch_tch_pdch.py: using RAC 175 05:38:12.434934 tst switch_tch_pdch.py: using CellId 19300 05:38:12.560169 tst switch_tch_pdch.py: using BVCI 19301 05:38:12.677846 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.690246 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.702132 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.717213 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.729059 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.741677 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.754783 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:38:12.767669 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:38:12.892573 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:38:13.014611 tst switch_tch_pdch.py:51: start network... 05:38:13.227657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:13.700410 run create_hlr_db(pid=29799): Launched 05:38:13.862769 bus /gobi_6: Setting Powered False 05:38:14.927443 run create_hlr_db(pid=29799): Terminated: ok {rc=0} 05:38:15.352555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Launched 05:38:15.695160 run osmo-hlr_10.42.42.2(pid=29802): Launched 05:38:15.938214 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:16.747218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Launched 05:38:17.150937 run osmo-stp_10.42.42.5(pid=29805): Launched 05:38:17.451521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:38:18.147916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29807): Launched 05:38:18.287309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:38:18.576733 run patchelf(pid=29808): Launched 05:38:18.788809 run osmo-stp_10.42.42.5(pid=29805): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] 05:38:18.926776 run osmo-stp_10.42.42.5(pid=29805): stdout: | (launched: 2022-12-09_05:38:17.075689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:19.065833 run osmo-stp_10.42.42.5(pid=29805): stderr: | 20221209053817469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053817469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053817470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053817471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053817471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053817471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053817471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:19.204470 run osmo-stp_10.42.42.5(pid=29805): stdout: | (launched: 2022-12-09_05:38:17.075689) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:19.337688 run osmo-stp_10.42.42.5(pid=29805): stderr: | 20221209053817469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053817469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053817470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053817471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053817471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053817471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053817471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:19.494226 run patchelf(pid=29808): Terminating (SIGINT) 05:38:19.678422 run patchelf(pid=29808): Terminated: ok {rc=0} 05:38:19.811053 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29805): Process ended prematurely: osmo-stp_10.42.42.5(pid=29805) [trial-2355↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] [trial-2355↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:38:19.821491 tst switch_tch_pdch.py:54: Test FAILED (7.7 sec) 05:38:19.852777 run osmo-hlr_10.42.42.2(pid=29802): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29802)] 05:38:19.905138 run osmo-hlr_10.42.42.2(pid=29802): stdout: | (launched: 2022-12-09_05:38:15.629530) 05:38:19.959959 run osmo-hlr_10.42.42.2(pid=29802): stderr: | 20221209053815993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053815993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053815993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053815993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053815993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053815993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053816015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053816030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053816030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053816030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:20.015533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Terminating (SIGTERM) 05:38:20.060421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Terminating (SIGTERM) 05:38:20.107140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29807): Terminating (SIGTERM) 05:38:20.154420 --- ParallelTerminationStrategy: PID 29801 died... 05:38:20.175752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29801): Terminated: ok {rc=0} 05:38:20.227329 --- ParallelTerminationStrategy: PID 29804 died... 05:38:20.247859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29804): Terminated: ok {rc=0} 05:38:20.297273 --- ParallelTerminationStrategy: PID 29807 died... 05:38:20.318720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29807): Terminated: ok {rc=0} 05:38:20.410712 bus /gobi_0: Setting Powered False 05:38:21.515216 bus /gobi_0: Setting Powered False 05:38:22.637593 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:oc2g --------------------------------------------------------------------- 05:38:23.885898 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:23.890531 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 05:38:23.914348 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 05:38:23.924066 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 05:38:23.978336 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 05:38:23.999944 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 05:38:24.009085 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 05:38:24.545162 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:38:24.551947 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 05:38:24.563977 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 05:38:24.604202 tst mo_mt_sms.py: using LAC 19301 05:38:24.732720 tst mo_mt_sms.py: using RAC 176 05:38:24.859030 tst mo_mt_sms.py: using CellId 19301 05:38:24.985562 tst mo_mt_sms.py: using BVCI 19302 05:38:25.102796 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:38:25.229651 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 05:38:25.347650 tst mo_mt_sms.py:9: start nitb and bts... 05:38:25.555404 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:38:26.185965 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29812): Launched 05:38:26.497533 run osmo-nitb_10.42.42.2(pid=29813): Launched 05:38:26.668847 run osmo-nitb_10.42.42.2(pid=29813): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29813)] 05:38:26.807622 run osmo-nitb_10.42.42.2(pid=29813): stdout: | (launched: 2022-12-09_05:38:26.439093) 05:38:26.947855 run osmo-nitb_10.42.42.2(pid=29813): stderr: | (launched: 2022-12-09_05:38:26.484658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:27.087892 run osmo-nitb_10.42.42.2(pid=29813): stdout: | (launched: 2022-12-09_05:38:26.439093) 05:38:27.222731 run osmo-nitb_10.42.42.2(pid=29813): stderr: | (launched: 2022-12-09_05:38:26.484658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29813) [trial-2355↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29813)] 05:38:27.614314 tst osmo-nitb_10.42.42.2(pid=29813): stdout: | (launched: 2022-12-09_05:38:26.439093) 05:38:27.738993 tst osmo-nitb_10.42.42.2(pid=29813): stderr: | (launched: 2022-12-09_05:38:26.484658) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:27.885854 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29813) [trial-2355↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29813)] [trial-2355↪nitb_sms:oc2g↪mo_mt_sms.py:11] 05:38:27.894428 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 05:38:27.901280 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29812): Terminating (SIGTERM) 05:38:28.110812 --- ParallelTerminationStrategy: PID 29812 died... 05:38:28.132716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29812): Terminated: ok {rc=0} 05:38:28.219441 bus /sierra_3: Setting Powered False 05:38:29.320392 bus /sierra_3: Setting Powered False 05:38:30.437745 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:oc2g --------------------------------------------------------------------- 05:38:31.654588 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:31.660221 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 05:38:31.683270 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 05:38:31.712441 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 05:38:31.767673 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 05:38:31.793268 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 05:38:31.828763 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 05:38:32.358145 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:oc2g mo_mt_sms.py ---------------------------------------------- 05:38:32.363485 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.374591 tst sms:oc2g: Using 1 x bts (candidates: 1) 05:38:32.409978 tst mo_mt_sms.py: using LAC 19302 05:38:32.532633 tst mo_mt_sms.py: using RAC 177 05:38:32.654848 tst mo_mt_sms.py: using CellId 19302 05:38:32.775517 tst mo_mt_sms.py: using BVCI 19303 05:38:32.886502 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.897090 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.907560 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.918427 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.929224 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 05:38:32.939880 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:33.059394 tst sms:oc2g: Using 1 x modem (candidates: 2) 05:38:33.176320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:33.656195 run create_hlr_db(pid=29817): Launched 05:38:33.772635 bus /sierra_2: Setting Powered False 05:38:34.834314 run create_hlr_db(pid=29817): Terminated: ok {rc=0} 05:38:35.264699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29819): Launched 05:38:35.574011 run osmo-hlr_10.42.42.2(pid=29820): Launched 05:38:35.690584 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:36.229968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29822): Launched 05:38:36.540776 run osmo-stp_10.42.42.5(pid=29823): Launched 05:38:36.658058 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:37.214706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29825): Launched 05:38:37.524589 run osmo-msc_10.42.42.6(pid=29826): Launched 05:38:37.695761 run osmo-stp_10.42.42.5(pid=29823): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29823)] 05:38:37.830640 run osmo-stp_10.42.42.5(pid=29823): stdout: | (launched: 2022-12-09_05:38:36.481846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:37.961340 run osmo-stp_10.42.42.5(pid=29823): stderr: | 20221209053836655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053836656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053836656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053836656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053836657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053836657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053836657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:38.090039 run osmo-stp_10.42.42.5(pid=29823): stdout: | (launched: 2022-12-09_05:38:36.481846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:38.212376 run osmo-stp_10.42.42.5(pid=29823): stderr: | 20221209053836655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053836656 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053836656 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053836656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053836657 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053836657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053836657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:38.359661 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29823): Process ended prematurely: osmo-stp_10.42.42.5(pid=29823) [trial-2355↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29823)] [trial-2355↪sms:oc2g↪mo_mt_sms.py:16] 05:38:38.368341 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 05:38:38.395028 run osmo-hlr_10.42.42.2(pid=29820): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29820)] 05:38:38.444058 run osmo-hlr_10.42.42.2(pid=29820): stdout: | (launched: 2022-12-09_05:38:35.515443) 05:38:38.494706 run osmo-hlr_10.42.42.2(pid=29820): stderr: | 20221209053835695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053835695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053835695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053835695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053835695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053835695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053835707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053835716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053835717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053835717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:38.565188 run osmo-msc_10.42.42.6(pid=29826): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29826)] 05:38:38.613853 run osmo-msc_10.42.42.6(pid=29826): stdout: | (launched: 2022-12-09_05:38:37.466055) 05:38:38.664151 run osmo-msc_10.42.42.6(pid=29826): stderr: | 20221209053837742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053837743 DLGLOBAL DEBUG validating counter group 0x7f5e7a1e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053837743 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053837743 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053837743 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053837743 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053837745 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053837745 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053837746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053837746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:38.714800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29819): Terminating (SIGTERM) 05:38:38.755494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29822): Terminating (SIGTERM) 05:38:38.796100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29825): Terminating (SIGTERM) 05:38:38.837369 --- ParallelTerminationStrategy: PID 29819 died... 05:38:38.856809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29819): Terminated: ok {rc=0} 05:38:38.903203 --- ParallelTerminationStrategy: PID 29822 died... 05:38:38.922416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29822): Terminated: ok {rc=0} 05:38:38.967967 --- ParallelTerminationStrategy: PID 29825 died... 05:38:38.987087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29825): Terminated: ok {rc=0} 05:38:39.075251 bus /sierra_3: Setting Powered False 05:38:40.175929 bus /sierra_3: Setting Powered False 05:38:41.293359 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:oc2g --------------------------------------------------------------------- 05:38:42.505310 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:42.509164 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:38:42.529775 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 05:38:42.538857 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:38:42.575372 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:38:42.597091 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 05:38:42.605102 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:38:43.120566 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 05:38:43.126542 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 05:38:43.137828 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 05:38:43.175355 tst assert_extension.py: using LAC 19303 05:38:43.294197 tst assert_extension.py: using RAC 178 05:38:43.415567 tst assert_extension.py: using CellId 19303 05:38:43.550676 tst assert_extension.py: using BVCI 19304 05:38:43.671243 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 05:38:43.788594 tst assert_extension.py:10: start nitb and bts... 05:38:43.995994 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:38:44.625170 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29831): Launched 05:38:44.934694 run osmo-nitb_10.42.42.2(pid=29832): Launched 05:38:45.104629 run osmo-nitb_10.42.42.2(pid=29832): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29832)] 05:38:45.243263 run osmo-nitb_10.42.42.2(pid=29832): stdout: | (launched: 2022-12-09_05:38:44.876299) 05:38:45.383493 run osmo-nitb_10.42.42.2(pid=29832): stderr: | (launched: 2022-12-09_05:38:44.921947) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:45.523450 run osmo-nitb_10.42.42.2(pid=29832): stdout: | (launched: 2022-12-09_05:38:44.876299) 05:38:45.657503 run osmo-nitb_10.42.42.2(pid=29832): stderr: | (launched: 2022-12-09_05:38:44.921947) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29832) [trial-2355↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29832)] 05:38:46.050090 tst osmo-nitb_10.42.42.2(pid=29832): stdout: | (launched: 2022-12-09_05:38:44.876299) 05:38:46.176400 tst osmo-nitb_10.42.42.2(pid=29832): stderr: | (launched: 2022-12-09_05:38:44.921947) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:38:46.327560 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29832) [trial-2355↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29832)] [trial-2355↪nitb_ussd:oc2g↪assert_extension.py:12] 05:38:46.337664 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:38:46.345466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29831): Terminating (SIGTERM) 05:38:46.559873 --- ParallelTerminationStrategy: PID 29831 died... 05:38:46.579764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29831): Terminated: ok {rc=0} 05:38:46.669679 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:oc2g --------------------------------------------------------------------- 05:38:47.834868 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:47.839024 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 05:38:47.860215 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 05:38:47.887986 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 05:38:47.925071 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 05:38:47.945730 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 05:38:47.972365 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 05:38:48.499846 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:oc2g assert_extension.py ---------------------------------------------- 05:38:48.505579 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:48.516145 tst ussd:oc2g: Using 1 x bts (candidates: 1) 05:38:48.550850 tst assert_extension.py: using LAC 19304 05:38:48.670233 tst assert_extension.py: using RAC 179 05:38:48.791135 tst assert_extension.py: using CellId 19304 05:38:48.913361 tst assert_extension.py: using BVCI 19305 05:38:49.033766 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:49.044829 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:49.055875 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:49.066817 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:49.078140 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 05:38:49.089020 tst ussd:oc2g: Using 1 x modem (candidates: 1) 05:38:49.206132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:49.684444 run create_hlr_db(pid=29836): Launched 05:38:49.802597 bus /sierra_2: Setting Powered False 05:38:50.863838 run create_hlr_db(pid=29836): Terminated: ok {rc=0} 05:38:51.317575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29838): Launched 05:38:51.650012 run osmo-hlr_10.42.42.2(pid=29839): Launched 05:38:51.777614 run osmo-stp_10.42.42.5: Starting osmo-stp 05:38:52.351243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29841): Launched 05:38:52.682440 run osmo-stp_10.42.42.5(pid=29843): Launched 05:38:52.807480 run osmo-msc_10.42.42.6: Starting osmo-msc 05:38:53.402637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29845): Launched 05:38:53.732678 run osmo-msc_10.42.42.6(pid=29846): Launched 05:38:53.915501 run osmo-stp_10.42.42.5(pid=29843): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29843)] 05:38:54.053531 run osmo-stp_10.42.42.5(pid=29843): stdout: | (launched: 2022-12-09_05:38:52.620339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:54.192016 run osmo-stp_10.42.42.5(pid=29843): stderr: | 20221209053852816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053852816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053852817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053852817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053852817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053852817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053852818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:54.330659 run osmo-stp_10.42.42.5(pid=29843): stdout: | (launched: 2022-12-09_05:38:52.620339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:38:54.461396 run osmo-stp_10.42.42.5(pid=29843): stderr: | 20221209053852816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053852816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053852817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053852817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053852817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053852817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053852818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:38:54.617796 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29843): Process ended prematurely: osmo-stp_10.42.42.5(pid=29843) [trial-2355↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29843)] [trial-2355↪ussd:oc2g↪assert_extension.py:17] 05:38:54.626783 tst assert_extension.py:17: Test FAILED (6.1 sec) 05:38:54.655673 run osmo-hlr_10.42.42.2(pid=29839): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29839)] 05:38:54.703914 run osmo-hlr_10.42.42.2(pid=29839): stdout: | (launched: 2022-12-09_05:38:51.587665) 05:38:54.754050 run osmo-hlr_10.42.42.2(pid=29839): stderr: | 20221209053851790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053851790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053851790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053851790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053851790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053851790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053851804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053851812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053851812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053851812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:38:54.823015 run osmo-msc_10.42.42.6(pid=29846): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29846)] 05:38:54.871180 run osmo-msc_10.42.42.6(pid=29846): stdout: | (launched: 2022-12-09_05:38:53.670807) 05:38:54.921478 run osmo-msc_10.42.42.6(pid=29846): stderr: | 20221209053853996 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053853996 DLGLOBAL DEBUG validating counter group 0x7fa78c3d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053853996 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053853996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053853997 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053853997 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053853998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053853999 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053853999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053853999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:38:54.971627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29838): Terminating (SIGTERM) 05:38:55.011826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29841): Terminating (SIGTERM) 05:38:55.051927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29845): Terminating (SIGTERM) 05:38:55.092504 --- ParallelTerminationStrategy: PID 29838 died... 05:38:55.111811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29838): Terminated: ok {rc=0} 05:38:55.156605 --- ParallelTerminationStrategy: PID 29841 died... 05:38:55.175547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29841): Terminated: ok {rc=0} 05:38:55.220216 --- ParallelTerminationStrategy: PID 29845 died... 05:38:55.239015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29845): Terminated: ok {rc=0} 05:38:55.326275 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:38:56.523009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:38:56.529385 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:38:56.550005 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:38:56.578527 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:38:56.632256 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:38:56.653160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:38:56.679735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:38:57.228071 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:38:57.279054 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.290198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:38:57.348280 tst mo_mt_call.py: using LAC 19305 05:38:57.477637 tst mo_mt_call.py: using RAC 180 05:38:57.599518 tst mo_mt_call.py: using CellId 19305 05:38:57.722220 tst mo_mt_call.py: using BVCI 19306 05:38:57.835627 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.846790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.857753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.869025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.880134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:38:57.891371 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:58.011709 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:38:58.132112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:38:58.623271 run create_hlr_db(pid=29852): Launched 05:38:58.742941 bus /sierra_2: Setting Powered False 05:38:59.804594 run create_hlr_db(pid=29852): Terminated: ok {rc=0} 05:39:00.264906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Launched 05:39:00.603256 run osmo-hlr_10.42.42.2(pid=29855): Launched 05:39:00.730745 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:01.403985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Launched 05:39:01.748406 run osmo-stp_10.42.42.5(pid=29858): Launched 05:39:01.898328 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:02.709581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Launched 05:39:03.046302 run osmo-msc_10.42.42.6(pid=29861): Launched 05:39:03.233325 run osmo-stp_10.42.42.5(pid=29858): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] 05:39:03.375970 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-09_05:39:01.683643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:03.516803 run osmo-stp_10.42.42.5(pid=29858): stderr: | 20221209053902094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053902095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053902097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053902099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053902101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053902101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053902102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:03.656280 run osmo-stp_10.42.42.5(pid=29858): stdout: | (launched: 2022-12-09_05:39:01.683643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:03.788822 run osmo-stp_10.42.42.5(pid=29858): stderr: | 20221209053902094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053902095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053902097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053902099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053902101 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053902101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053902102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:03.947829 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:39:03.957420 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 05:39:03.985378 run osmo-hlr_10.42.42.2(pid=29855): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29855)] 05:39:04.035961 run osmo-hlr_10.42.42.2(pid=29855): stdout: | (launched: 2022-12-09_05:39:00.539757) 05:39:04.088060 run osmo-hlr_10.42.42.2(pid=29855): stderr: | 20221209053900743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053900743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053900743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053900743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053900743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053900743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053900755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053900764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053900765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053900765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:04.160712 run osmo-msc_10.42.42.6(pid=29861): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29861)] 05:39:04.211013 run osmo-msc_10.42.42.6(pid=29861): stdout: | (launched: 2022-12-09_05:39:02.982857) 05:39:04.262762 run osmo-msc_10.42.42.6(pid=29861): stderr: | 20221209053903310 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053903311 DLGLOBAL DEBUG validating counter group 0x7f27b59d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053903311 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053903311 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053903311 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053903312 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053903313 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053903314 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053903314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053903314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:04.315410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminating (SIGTERM) 05:39:04.357374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminating (SIGTERM) 05:39:04.399368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Terminating (SIGTERM) 05:39:04.441655 --- ParallelTerminationStrategy: PID 29854 died... 05:39:04.461814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29854): Terminated: ok {rc=0} 05:39:04.508400 --- ParallelTerminationStrategy: PID 29857 died... 05:39:04.528450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29857): Terminated: ok {rc=0} 05:39:04.575283 --- ParallelTerminationStrategy: PID 29860 died... 05:39:04.594996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29860): Terminated: ok {rc=0} 05:39:04.683322 bus /sierra_3: Setting Powered False 05:39:05.783307 bus /sierra_3: Setting Powered False 05:39:06.900474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:39:08.050326 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.062666 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:39:08.121147 tst mo_mt_call_osmux.py: using LAC 19306 05:39:08.256630 tst mo_mt_call_osmux.py: using RAC 181 05:39:08.388881 tst mo_mt_call_osmux.py: using CellId 19306 05:39:08.518959 tst mo_mt_call_osmux.py: using BVCI 19307 05:39:08.641295 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.652888 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.664405 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.675806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.687160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:39:08.698635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:08.816797 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:39:08.935139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:09.425908 run create_hlr_db(pid=29863): Launched 05:39:09.546818 bus /sierra_2: Setting Powered False 05:39:10.609814 run create_hlr_db(pid=29863): Terminated: ok {rc=0} 05:39:11.048619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Launched 05:39:11.364824 run osmo-hlr_10.42.42.2(pid=29866): Launched 05:39:11.484705 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:12.042118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Launched 05:39:12.358981 run osmo-stp_10.42.42.5(pid=29869): Launched 05:39:12.479376 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:13.049200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Launched 05:39:13.364877 run osmo-msc_10.42.42.6(pid=29872): Launched 05:39:13.540121 run osmo-stp_10.42.42.5(pid=29869): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] 05:39:13.675378 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-09_05:39:12.299156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:13.807855 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221209053912472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053912472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053912473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053912473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053912475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053912475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053912475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:13.938386 run osmo-stp_10.42.42.5(pid=29869): stdout: | (launched: 2022-12-09_05:39:12.299156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:14.062534 run osmo-stp_10.42.42.5(pid=29869): stderr: | 20221209053912472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053912472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053912473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053912473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053912475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053912475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053912475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:14.211848 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:39:14.220721 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:39:14.248124 run osmo-hlr_10.42.42.2(pid=29866): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29866)] 05:39:14.297146 run osmo-hlr_10.42.42.2(pid=29866): stdout: | (launched: 2022-12-09_05:39:11.305288) 05:39:14.347683 run osmo-hlr_10.42.42.2(pid=29866): stderr: | 20221209053911484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053911484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053911484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053911484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053911484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053911484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053911496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053911505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053911505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053911505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:14.418129 run osmo-msc_10.42.42.6(pid=29872): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29872)] 05:39:14.466768 run osmo-msc_10.42.42.6(pid=29872): stdout: | (launched: 2022-12-09_05:39:13.305238) 05:39:14.517167 run osmo-msc_10.42.42.6(pid=29872): stderr: | 20221209053913584 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053913584 DLGLOBAL DEBUG validating counter group 0x7f5b3cf14c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053913584 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053913584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053913584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053913584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053913586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053913587 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053913587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053913587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:14.567963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminating (SIGTERM) 05:39:14.608914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminating (SIGTERM) 05:39:14.649920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminating (SIGTERM) 05:39:14.691042 --- ParallelTerminationStrategy: PID 29865 died... 05:39:14.710611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29865): Terminated: ok {rc=0} 05:39:14.755913 --- ParallelTerminationStrategy: PID 29868 died... 05:39:14.774930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29868): Terminated: ok {rc=0} 05:39:14.820245 --- ParallelTerminationStrategy: PID 29871 died... 05:39:14.839260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29871): Terminated: ok {rc=0} 05:39:14.926284 bus /sierra_3: Setting Powered False 05:39:16.031444 bus /sierra_3: Setting Powered False 05:39:17.156567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:39:18.395598 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:18.402925 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:39:18.424522 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:39:18.452289 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:39:18.507039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:39:18.528622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:39:18.555951 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:39:19.105887 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:39:19.159256 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.170917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:39:19.228688 tst mo_mt_call.py: using LAC 19307 05:39:19.361327 tst mo_mt_call.py: using RAC 182 05:39:19.494308 tst mo_mt_call.py: using CellId 19307 05:39:19.625848 tst mo_mt_call.py: using BVCI 19308 05:39:19.742485 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.753737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.764619 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.775780 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.786865 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:19.798099 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:19.917937 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:20.040336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:20.566526 run create_hlr_db(pid=29877): Launched 05:39:20.704562 bus /sierra_2: Setting Powered False 05:39:21.771133 run create_hlr_db(pid=29877): Terminated: ok {rc=0} 05:39:22.221058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29879): Launched 05:39:22.537201 run osmo-hlr_10.42.42.2(pid=29880): Launched 05:39:22.657909 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:23.200393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29882): Launched 05:39:23.516331 run osmo-stp_10.42.42.5(pid=29883): Launched 05:39:23.636276 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:24.204714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29885): Launched 05:39:24.521981 run osmo-msc_10.42.42.6(pid=29886): Launched 05:39:24.699124 run osmo-stp_10.42.42.5(pid=29883): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29883)] 05:39:24.833471 run osmo-stp_10.42.42.5(pid=29883): stdout: | (launched: 2022-12-09_05:39:23.456534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:24.966564 run osmo-stp_10.42.42.5(pid=29883): stderr: | 20221209053923630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053923630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053923631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053923631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053923631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053923632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053923632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:25.098408 run osmo-stp_10.42.42.5(pid=29883): stdout: | (launched: 2022-12-09_05:39:23.456534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:25.223357 run osmo-stp_10.42.42.5(pid=29883): stderr: | 20221209053923630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053923630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053923631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053923631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053923631 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053923632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053923632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:25.372827 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29883): Process ended prematurely: osmo-stp_10.42.42.5(pid=29883) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29883)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:39:25.381835 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:39:25.409250 run osmo-hlr_10.42.42.2(pid=29880): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29880)] 05:39:25.458267 run osmo-hlr_10.42.42.2(pid=29880): stdout: | (launched: 2022-12-09_05:39:22.477563) 05:39:25.508893 run osmo-hlr_10.42.42.2(pid=29880): stderr: | 20221209053922660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053922660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053922660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053922660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053922660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053922660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053922672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053922681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053922681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053922681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:25.579826 run osmo-msc_10.42.42.6(pid=29886): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29886)] 05:39:25.629430 run osmo-msc_10.42.42.6(pid=29886): stdout: | (launched: 2022-12-09_05:39:24.460810) 05:39:25.679804 run osmo-msc_10.42.42.6(pid=29886): stderr: | 20221209053924740 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053924740 DLGLOBAL DEBUG validating counter group 0x7f67b9d53c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053924740 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053924740 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053924740 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053924741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053924742 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053924743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053924743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053924743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:25.730564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29879): Terminating (SIGTERM) 05:39:25.770985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29882): Terminating (SIGTERM) 05:39:25.811993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29885): Terminating (SIGTERM) 05:39:25.852652 --- ParallelTerminationStrategy: PID 29879 died... 05:39:25.871980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29879): Terminated: ok {rc=0} 05:39:25.917017 --- ParallelTerminationStrategy: PID 29882 died... 05:39:25.935825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29882): Terminated: ok {rc=0} 05:39:25.980573 --- ParallelTerminationStrategy: PID 29885 died... 05:39:25.999439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29885): Terminated: ok {rc=0} 05:39:26.087566 bus /sierra_3: Setting Powered False 05:39:27.188825 bus /sierra_3: Setting Powered False 05:39:28.305353 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:39:29.456578 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:29.468503 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:39:29.525472 tst mo_mt_call_osmux.py: using LAC 19308 05:39:29.659678 tst mo_mt_call_osmux.py: using RAC 183 05:39:29.793380 tst mo_mt_call_osmux.py: using CellId 19308 05:39:29.925480 tst mo_mt_call_osmux.py: using BVCI 19309 05:39:30.048172 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:30.059792 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:30.071189 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:30.083125 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:30.095197 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:39:30.107177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:30.226568 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:39:30.353753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:30.910619 run create_hlr_db(pid=29888): Launched 05:39:31.071447 bus /sierra_2: Setting Powered False 05:39:32.133449 run create_hlr_db(pid=29888): Terminated: ok {rc=0} 05:39:32.596823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Launched 05:39:32.935316 run osmo-hlr_10.42.42.2(pid=29891): Launched 05:39:33.062596 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:33.645467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Launched 05:39:33.983091 run osmo-stp_10.42.42.5(pid=29894): Launched 05:39:34.112845 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:34.722570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29896): Launched 05:39:35.060359 run osmo-msc_10.42.42.6(pid=29897): Launched 05:39:35.246923 run osmo-stp_10.42.42.5(pid=29894): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] 05:39:35.392382 run osmo-stp_10.42.42.5(pid=29894): stdout: | (launched: 2022-12-09_05:39:33.919771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:35.534351 run osmo-stp_10.42.42.5(pid=29894): stderr: | 20221209053934117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053934117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053934117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053934118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053934118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053934118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053934118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:35.675043 run osmo-stp_10.42.42.5(pid=29894): stdout: | (launched: 2022-12-09_05:39:33.919771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:35.807646 run osmo-stp_10.42.42.5(pid=29894): stderr: | 20221209053934117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053934117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053934117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053934118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053934118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053934118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053934118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:35.966490 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29894): Process ended prematurely: osmo-stp_10.42.42.5(pid=29894) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:39:35.976028 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:39:36.003997 run osmo-hlr_10.42.42.2(pid=29891): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29891)] 05:39:36.054331 run osmo-hlr_10.42.42.2(pid=29891): stdout: | (launched: 2022-12-09_05:39:32.871899) 05:39:36.106652 run osmo-hlr_10.42.42.2(pid=29891): stderr: | 20221209053933073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053933073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053933073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053933073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053933073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053933074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053933086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053933097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053933097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053933097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:36.179508 run osmo-msc_10.42.42.6(pid=29897): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29897)] 05:39:36.230032 run osmo-msc_10.42.42.6(pid=29897): stdout: | (launched: 2022-12-09_05:39:34.997362) 05:39:36.282150 run osmo-msc_10.42.42.6(pid=29897): stderr: | 20221209053935324 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053935324 DLGLOBAL DEBUG validating counter group 0x7fb681ba5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053935324 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053935324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053935325 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053935325 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053935326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053935327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053935327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053935327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:36.334994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Terminating (SIGTERM) 05:39:36.377116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Terminating (SIGTERM) 05:39:36.419244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29896): Terminating (SIGTERM) 05:39:36.461751 --- ParallelTerminationStrategy: PID 29890 died... 05:39:36.482004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29890): Terminated: ok {rc=0} 05:39:36.528678 --- ParallelTerminationStrategy: PID 29893 died... 05:39:36.548429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29893): Terminated: ok {rc=0} 05:39:36.594931 --- ParallelTerminationStrategy: PID 29896 died... 05:39:36.614596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29896): Terminated: ok {rc=0} 05:39:36.702079 bus /sierra_3: Setting Powered False 05:39:37.801215 bus /sierra_3: Setting Powered False 05:39:38.918124 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:39:40.162606 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:39:40.169647 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:39:40.190929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:39:40.219332 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:39:40.271303 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:39:40.292601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:39:40.320335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:39:40.873814 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:39:40.927084 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:40.938645 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:39:40.995337 tst mo_mt_call.py: using LAC 19309 05:39:41.125163 tst mo_mt_call.py: using RAC 184 05:39:41.259137 tst mo_mt_call.py: using CellId 19309 05:39:41.391330 tst mo_mt_call.py: using BVCI 19310 05:39:41.515029 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:41.526685 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:41.538084 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:41.549481 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:41.560863 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:41.572322 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:41.690820 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:41.812210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:42.336872 run create_hlr_db(pid=29902): Launched 05:39:42.473070 bus /sierra_2: Setting Powered False 05:39:43.539342 run create_hlr_db(pid=29902): Terminated: ok {rc=0} 05:39:44.006515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Launched 05:39:44.345546 run osmo-hlr_10.42.42.2(pid=29905): Launched 05:39:44.472669 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:45.056242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Launched 05:39:45.393362 run osmo-stp_10.42.42.5(pid=29908): Launched 05:39:45.520251 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:46.142576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29910): Launched 05:39:46.475828 run osmo-msc_10.42.42.6(pid=29911): Launched 05:39:46.843862 run osmo-stp_10.42.42.5(pid=29908): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] 05:39:47.104693 run osmo-stp_10.42.42.5(pid=29908): stdout: | (launched: 2022-12-09_05:39:45.330045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:47.246126 run osmo-stp_10.42.42.5(pid=29908): stderr: | 20221209053945528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053945528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053945529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053945529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053945530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053945530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053945530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:47.380326 run osmo-stp_10.42.42.5(pid=29908): stdout: | (launched: 2022-12-09_05:39:45.330045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:47.505217 run osmo-stp_10.42.42.5(pid=29908): stderr: | 20221209053945528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053945528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053945529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053945529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053945530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053945530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053945530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:47.654531 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29908): Process ended prematurely: osmo-stp_10.42.42.5(pid=29908) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:39:47.663536 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 05:39:47.691162 run osmo-hlr_10.42.42.2(pid=29905): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29905)] 05:39:47.740292 run osmo-hlr_10.42.42.2(pid=29905): stdout: | (launched: 2022-12-09_05:39:44.281531) 05:39:47.791151 run osmo-hlr_10.42.42.2(pid=29905): stderr: | 20221209053944484 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053944484 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053944484 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053944484 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053944484 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053944484 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053944496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053944505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053944506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053944506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:47.862142 run osmo-msc_10.42.42.6(pid=29911): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29911)] 05:39:47.911150 run osmo-msc_10.42.42.6(pid=29911): stdout: | (launched: 2022-12-09_05:39:46.412855) 05:39:47.961712 run osmo-msc_10.42.42.6(pid=29911): stderr: | 20221209053947016 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053947021 DLGLOBAL DEBUG validating counter group 0x7f50c9290c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053947021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053947021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053947021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053947021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053947029 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053947030 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053947030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053947030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:48.012639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Terminating (SIGTERM) 05:39:48.053352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Terminating (SIGTERM) 05:39:48.094033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29910): Terminating (SIGTERM) 05:39:48.135167 --- ParallelTerminationStrategy: PID 29904 died... 05:39:48.154699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29904): Terminated: ok {rc=0} 05:39:48.200280 --- ParallelTerminationStrategy: PID 29907 died... 05:39:48.219278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29907): Terminated: ok {rc=0} 05:39:48.264650 --- ParallelTerminationStrategy: PID 29910 died... 05:39:48.283562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29910): Terminated: ok {rc=0} 05:39:48.370635 bus /sierra_3: Setting Powered False 05:39:49.471439 bus /sierra_3: Setting Powered False 05:39:50.588453 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:39:51.737238 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:51.748924 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:39:51.805374 tst mo_mt_call_osmux.py: using LAC 19310 05:39:51.930321 tst mo_mt_call_osmux.py: using RAC 185 05:39:52.054924 tst mo_mt_call_osmux.py: using CellId 19310 05:39:52.179761 tst mo_mt_call_osmux.py: using BVCI 19311 05:39:52.304349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:52.316293 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:52.328155 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:52.340355 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:52.352484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:39:52.364395 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:52.483508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:39:52.605168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:39:53.133092 run create_hlr_db(pid=29913): Launched 05:39:53.269633 bus /sierra_2: Setting Powered False 05:39:54.332589 run create_hlr_db(pid=29913): Terminated: ok {rc=0} 05:39:54.782873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29915): Launched 05:39:55.099768 run osmo-hlr_10.42.42.2(pid=29916): Launched 05:39:55.219705 run osmo-stp_10.42.42.5: Starting osmo-stp 05:39:55.764267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29918): Launched 05:39:56.079446 run osmo-stp_10.42.42.5(pid=29919): Launched 05:39:56.198555 run osmo-msc_10.42.42.6: Starting osmo-msc 05:39:56.766311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29921): Launched 05:39:57.082258 run osmo-msc_10.42.42.6(pid=29922): Launched 05:39:57.256860 run osmo-stp_10.42.42.5(pid=29919): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29919)] 05:39:57.390093 run osmo-stp_10.42.42.5(pid=29919): stdout: | (launched: 2022-12-09_05:39:56.019541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:57.522584 run osmo-stp_10.42.42.5(pid=29919): stderr: | 20221209053956193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053956193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053956194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053956194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053956196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053956196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053956196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:57.652736 run osmo-stp_10.42.42.5(pid=29919): stdout: | (launched: 2022-12-09_05:39:56.019541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:39:57.777242 run osmo-stp_10.42.42.5(pid=29919): stderr: | 20221209053956193 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209053956193 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209053956194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209053956194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209053956196 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209053956196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209053956196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:39:57.925954 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29919): Process ended prematurely: osmo-stp_10.42.42.5(pid=29919) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29919)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:39:57.934836 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:39:57.962086 run osmo-hlr_10.42.42.2(pid=29916): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29916)] 05:39:58.010833 run osmo-hlr_10.42.42.2(pid=29916): stdout: | (launched: 2022-12-09_05:39:55.039659) 05:39:58.061224 run osmo-hlr_10.42.42.2(pid=29916): stderr: | 20221209053955221 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209053955221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209053955222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209053955222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209053955222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209053955222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209053955234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209053955243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209053955243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209053955243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:39:58.131154 run osmo-msc_10.42.42.6(pid=29922): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29922)] 05:39:58.179667 run osmo-msc_10.42.42.6(pid=29922): stdout: | (launched: 2022-12-09_05:39:57.022596) 05:39:58.229850 run osmo-msc_10.42.42.6(pid=29922): stderr: | 20221209053957297 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209053957297 DLGLOBAL DEBUG validating counter group 0x7f7380ce7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209053957298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209053957298 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209053957298 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209053957298 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209053957300 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209053957300 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209053957300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209053957300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:39:58.280637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29915): Terminating (SIGTERM) 05:39:58.321131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29918): Terminating (SIGTERM) 05:39:58.361549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29921): Terminating (SIGTERM) 05:39:58.402499 --- ParallelTerminationStrategy: PID 29915 died... 05:39:58.421901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29915): Terminated: ok {rc=0} 05:39:58.467018 --- ParallelTerminationStrategy: PID 29918 died... 05:39:58.485842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29918): Terminated: ok {rc=0} 05:39:58.530986 --- ParallelTerminationStrategy: PID 29921 died... 05:39:58.549924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29921): Terminated: ok {rc=0} 05:39:58.634978 bus /sierra_3: Setting Powered False 05:39:59.733969 bus /sierra_3: Setting Powered False 05:40:00.849215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:40:02.122901 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:02.133152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:40:02.165122 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:40:02.198645 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:40:02.255045 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:40:02.278557 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:40:02.308358 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:40:02.854318 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:40:02.905937 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:02.917091 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:40:02.973708 tst mo_mt_call.py: using LAC 19311 05:40:03.111273 tst mo_mt_call.py: using RAC 186 05:40:03.242688 tst mo_mt_call.py: using CellId 19311 05:40:03.374991 tst mo_mt_call.py: using BVCI 19312 05:40:03.491611 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:03.502871 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:03.514221 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:03.526234 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:03.537863 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:03.549503 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:03.672524 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:03.793958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:04.284219 run create_hlr_db(pid=29931): Launched 05:40:04.405509 bus /sierra_2: Setting Powered False 05:40:05.467832 run create_hlr_db(pid=29931): Terminated: ok {rc=0} 05:40:05.906878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Launched 05:40:06.223589 run osmo-hlr_10.42.42.2(pid=29934): Launched 05:40:06.343303 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:06.897561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Launched 05:40:07.212669 run osmo-stp_10.42.42.5(pid=29937): Launched 05:40:07.332479 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:07.899849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29939): Launched 05:40:08.239201 run osmo-msc_10.42.42.6(pid=29940): Launched 05:40:08.426878 run osmo-stp_10.42.42.5(pid=29937): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] 05:40:08.569481 run osmo-stp_10.42.42.5(pid=29937): stdout: | (launched: 2022-12-09_05:40:07.153280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:08.713230 run osmo-stp_10.42.42.5(pid=29937): stderr: | 20221209054007329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054007329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054007329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054007330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054007330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054007330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054007330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:08.853404 run osmo-stp_10.42.42.5(pid=29937): stdout: | (launched: 2022-12-09_05:40:07.153280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:08.986121 run osmo-stp_10.42.42.5(pid=29937): stderr: | 20221209054007329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054007329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054007329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054007330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054007330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054007330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054007330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:09.145811 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29937): Process ended prematurely: osmo-stp_10.42.42.5(pid=29937) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:40:09.155324 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:40:09.183410 run osmo-hlr_10.42.42.2(pid=29934): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29934)] 05:40:09.234127 run osmo-hlr_10.42.42.2(pid=29934): stdout: | (launched: 2022-12-09_05:40:06.163572) 05:40:09.286510 run osmo-hlr_10.42.42.2(pid=29934): stderr: | 20221209054006346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054006346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054006346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054006346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054006346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054006346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054006358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054006367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054006367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054006367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:09.359850 run osmo-msc_10.42.42.6(pid=29940): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29940)] 05:40:09.410655 run osmo-msc_10.42.42.6(pid=29940): stdout: | (launched: 2022-12-09_05:40:08.175927) 05:40:09.462860 run osmo-msc_10.42.42.6(pid=29940): stderr: | 20221209054008502 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054008503 DLGLOBAL DEBUG validating counter group 0x7f5ee1a94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054008503 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054008503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054008503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054008503 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054008506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054008507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054008507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054008507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:09.515543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Terminating (SIGTERM) 05:40:09.558251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Terminating (SIGTERM) 05:40:09.600915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29939): Terminating (SIGTERM) 05:40:09.643345 --- ParallelTerminationStrategy: PID 29933 died... 05:40:09.663592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29933): Terminated: ok {rc=0} 05:40:09.710153 --- ParallelTerminationStrategy: PID 29936 died... 05:40:09.729623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29936): Terminated: ok {rc=0} 05:40:09.776125 --- ParallelTerminationStrategy: PID 29939 died... 05:40:09.795727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29939): Terminated: ok {rc=0} 05:40:09.883916 bus /sierra_3: Setting Powered False 05:40:10.984559 bus /sierra_3: Setting Powered False 05:40:12.103624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:40:13.258525 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.270988 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:40:13.329873 tst mo_mt_call_osmux.py: using LAC 19312 05:40:13.463310 tst mo_mt_call_osmux.py: using RAC 187 05:40:13.596043 tst mo_mt_call_osmux.py: using CellId 19312 05:40:13.728600 tst mo_mt_call_osmux.py: using BVCI 19313 05:40:13.851088 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.862680 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.874048 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.885792 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.897203 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:40:13.908526 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:14.025320 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:40:14.147008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:14.637938 run create_hlr_db(pid=29942): Launched 05:40:14.758750 bus /sierra_2: Setting Powered False 05:40:15.821330 run create_hlr_db(pid=29942): Terminated: ok {rc=0} 05:40:16.288783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29944): Launched 05:40:16.660327 run osmo-hlr_10.42.42.2(pid=29945): Launched 05:40:16.897445 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:17.522986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29947): Launched 05:40:17.838998 run osmo-stp_10.42.42.5(pid=29948): Launched 05:40:17.958836 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:18.527974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29950): Launched 05:40:18.842973 run osmo-msc_10.42.42.6(pid=29951): Launched 05:40:19.018587 run osmo-stp_10.42.42.5(pid=29948): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29948)] 05:40:19.151942 run osmo-stp_10.42.42.5(pid=29948): stdout: | (launched: 2022-12-09_05:40:17.779187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:19.284170 run osmo-stp_10.42.42.5(pid=29948): stderr: | 20221209054017955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054017955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054017955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054017956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054017956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054017956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054017956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:19.414532 run osmo-stp_10.42.42.5(pid=29948): stdout: | (launched: 2022-12-09_05:40:17.779187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:19.538496 run osmo-stp_10.42.42.5(pid=29948): stderr: | 20221209054017955 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054017955 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054017955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054017956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054017956 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054017956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054017956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:19.686712 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29948): Process ended prematurely: osmo-stp_10.42.42.5(pid=29948) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29948)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:40:19.695609 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:40:19.722534 run osmo-hlr_10.42.42.2(pid=29945): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29945)] 05:40:19.771000 run osmo-hlr_10.42.42.2(pid=29945): stdout: | (launched: 2022-12-09_05:40:16.594858) 05:40:19.821287 run osmo-hlr_10.42.42.2(pid=29945): stderr: | 20221209054016933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054016933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054016933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054016933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054016933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054016933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054016957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054016966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054016966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054016966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:19.891154 run osmo-msc_10.42.42.6(pid=29951): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29951)] 05:40:19.939649 run osmo-msc_10.42.42.6(pid=29951): stdout: | (launched: 2022-12-09_05:40:18.783326) 05:40:19.989666 run osmo-msc_10.42.42.6(pid=29951): stderr: | 20221209054019060 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054019060 DLGLOBAL DEBUG validating counter group 0x7f18df5bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054019060 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054019060 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054019061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054019061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054019063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054019063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054019063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054019063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:20.040188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29944): Terminating (SIGTERM) 05:40:20.080741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29947): Terminating (SIGTERM) 05:40:20.121262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29950): Terminating (SIGTERM) 05:40:20.162172 --- ParallelTerminationStrategy: PID 29944 died... 05:40:20.181545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29944): Terminated: ok {rc=0} 05:40:20.226566 --- ParallelTerminationStrategy: PID 29947 died... 05:40:20.245271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29947): Terminated: ok {rc=0} 05:40:20.290337 --- ParallelTerminationStrategy: PID 29950 died... 05:40:20.309137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29950): Terminated: ok {rc=0} 05:40:20.397092 bus /sierra_3: Setting Powered False 05:40:21.497862 bus /sierra_3: Setting Powered False 05:40:22.615043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:40:23.853987 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:23.860862 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:40:23.882384 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:40:23.909856 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:40:23.964102 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:40:23.985601 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:40:24.013056 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:40:24.563205 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:40:24.616674 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:24.628244 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:40:24.686658 tst mo_mt_call.py: using LAC 19313 05:40:24.819309 tst mo_mt_call.py: using RAC 188 05:40:24.952319 tst mo_mt_call.py: using CellId 19313 05:40:25.083372 tst mo_mt_call.py: using BVCI 19314 05:40:25.208217 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:25.219882 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:25.231227 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:25.242696 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:25.254107 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:25.265877 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:25.385347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:25.504604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:26.028592 run create_hlr_db(pid=29956): Launched 05:40:26.164070 bus /sierra_2: Setting Powered False 05:40:27.230117 run create_hlr_db(pid=29956): Terminated: ok {rc=0} 05:40:27.699125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29958): Launched 05:40:28.037302 run osmo-hlr_10.42.42.2(pid=29959): Launched 05:40:28.164316 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:28.747042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29961): Launched 05:40:29.084304 run osmo-stp_10.42.42.5(pid=29962): Launched 05:40:29.211599 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:29.820118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29964): Launched 05:40:30.157120 run osmo-msc_10.42.42.6(pid=29965): Launched 05:40:30.343913 run osmo-stp_10.42.42.5(pid=29962): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29962)] 05:40:30.487082 run osmo-stp_10.42.42.5(pid=29962): stdout: | (launched: 2022-12-09_05:40:29.021117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:30.627937 run osmo-stp_10.42.42.5(pid=29962): stderr: | 20221209054029218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054029218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054029218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054029219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054029219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054029219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054029219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:30.767886 run osmo-stp_10.42.42.5(pid=29962): stdout: | (launched: 2022-12-09_05:40:29.021117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:30.935123 run osmo-stp_10.42.42.5(pid=29962): stderr: | 20221209054029218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054029218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054029218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054029219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054029219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054029219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054029219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:31.099895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29962): Process ended prematurely: osmo-stp_10.42.42.5(pid=29962) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29962)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:40:31.110650 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 05:40:31.140015 run osmo-hlr_10.42.42.2(pid=29959): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29959)] 05:40:31.191820 run osmo-hlr_10.42.42.2(pid=29959): stdout: | (launched: 2022-12-09_05:40:27.974191) 05:40:31.245520 run osmo-hlr_10.42.42.2(pid=29959): stderr: | 20221209054028178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054028178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054028178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054028178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054028178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054028178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054028190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054028199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054028199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054028199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:31.319767 run osmo-msc_10.42.42.6(pid=29965): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29965)] 05:40:31.372100 run osmo-msc_10.42.42.6(pid=29965): stdout: | (launched: 2022-12-09_05:40:30.093928) 05:40:31.425332 run osmo-msc_10.42.42.6(pid=29965): stderr: | 20221209054030425 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054030425 DLGLOBAL DEBUG validating counter group 0x7f52870bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054030425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054030425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054030425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054030425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054030427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054030427 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054030428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054030428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:31.479162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29958): Terminating (SIGTERM) 05:40:31.522865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29961): Terminating (SIGTERM) 05:40:31.567903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29964): Terminating (SIGTERM) 05:40:31.612814 --- ParallelTerminationStrategy: PID 29958 died... 05:40:31.633348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29958): Terminated: ok {rc=0} 05:40:31.680753 --- ParallelTerminationStrategy: PID 29961 died... 05:40:31.701244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29961): Terminated: ok {rc=0} 05:40:31.748835 --- ParallelTerminationStrategy: PID 29964 died... 05:40:31.769192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29964): Terminated: ok {rc=0} 05:40:31.858728 bus /sierra_3: Setting Powered False 05:40:32.956644 bus /sierra_3: Setting Powered False 05:40:34.073551 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:40:35.225831 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.238196 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:40:35.297137 tst mo_mt_call_osmux.py: using LAC 19314 05:40:35.430259 tst mo_mt_call_osmux.py: using RAC 189 05:40:35.561186 tst mo_mt_call_osmux.py: using CellId 19314 05:40:35.692701 tst mo_mt_call_osmux.py: using BVCI 19315 05:40:35.814841 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.826538 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.837949 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.849341 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.860694 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:40:35.872215 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:35.991222 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:40:36.112446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:36.635911 run create_hlr_db(pid=29967): Launched 05:40:36.771043 bus /sierra_2: Setting Powered False 05:40:37.836324 run create_hlr_db(pid=29967): Terminated: ok {rc=0} 05:40:38.283827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29969): Launched 05:40:38.600899 run osmo-hlr_10.42.42.2(pid=29970): Launched 05:40:38.722319 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:39.268179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29972): Launched 05:40:39.585050 run osmo-stp_10.42.42.5(pid=29973): Launched 05:40:39.705461 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:40.275479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29975): Launched 05:40:40.592864 run osmo-msc_10.42.42.6(pid=29976): Launched 05:40:40.771203 run osmo-stp_10.42.42.5(pid=29973): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29973)] 05:40:40.905510 run osmo-stp_10.42.42.5(pid=29973): stdout: | (launched: 2022-12-09_05:40:39.524882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:41.038147 run osmo-stp_10.42.42.5(pid=29973): stderr: | 20221209054039699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054039699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054039699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054039700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054039700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054039700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054039700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:41.168655 run osmo-stp_10.42.42.5(pid=29973): stdout: | (launched: 2022-12-09_05:40:39.524882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:41.292905 run osmo-stp_10.42.42.5(pid=29973): stderr: | 20221209054039699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054039699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054039699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054039700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054039700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054039700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054039700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:41.441542 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29973): Process ended prematurely: osmo-stp_10.42.42.5(pid=29973) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29973)] [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:40:41.450402 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:40:41.477531 run osmo-hlr_10.42.42.2(pid=29970): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29970)] 05:40:41.526416 run osmo-hlr_10.42.42.2(pid=29970): stdout: | (launched: 2022-12-09_05:40:38.541175) 05:40:41.576628 run osmo-hlr_10.42.42.2(pid=29970): stderr: | 20221209054038720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054038720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054038720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054038720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054038720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054038720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054038732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054038740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054038740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054038740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:41.646691 run osmo-msc_10.42.42.6(pid=29976): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29976)] 05:40:41.694940 run osmo-msc_10.42.42.6(pid=29976): stdout: | (launched: 2022-12-09_05:40:40.533268) 05:40:41.744811 run osmo-msc_10.42.42.6(pid=29976): stderr: | 20221209054040810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054040811 DLGLOBAL DEBUG validating counter group 0x7f4c953a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054040811 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054040811 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054040811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054040811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054040813 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054040813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054040814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054040814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:41.795164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29969): Terminating (SIGTERM) 05:40:41.835565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29972): Terminating (SIGTERM) 05:40:41.876001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29975): Terminating (SIGTERM) 05:40:41.942147 --- ParallelTerminationStrategy: PID 29969 died... 05:40:41.961399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29969): Terminated: ok {rc=0} 05:40:42.006939 --- ParallelTerminationStrategy: PID 29972 died... 05:40:42.025847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29972): Terminated: ok {rc=0} 05:40:42.070883 --- ParallelTerminationStrategy: PID 29975 died... 05:40:42.089721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29975): Terminated: ok {rc=0} 05:40:42.175563 bus /sierra_3: Setting Powered False 05:40:43.276488 bus /sierra_3: Setting Powered False 05:40:44.394213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:40:45.632871 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:40:45.639600 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:40:45.660732 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:40:45.687523 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:40:45.741777 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:40:45.762750 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:40:45.789451 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:40:46.366840 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:40:46.442459 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:46.457880 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:40:46.527992 tst mo_mt_call.py: using LAC 19315 05:40:46.664928 tst mo_mt_call.py: using RAC 190 05:40:46.805993 tst mo_mt_call.py: using CellId 19315 05:40:46.933670 tst mo_mt_call.py: using BVCI 19316 05:40:47.092517 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:47.107663 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:47.123348 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:47.137787 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:47.149933 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:47.163935 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:47.287315 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:47.409942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:47.933166 run create_hlr_db(pid=29982): Launched 05:40:48.069466 bus /sierra_2: Setting Powered False 05:40:49.135193 run create_hlr_db(pid=29982): Terminated: ok {rc=0} 05:40:49.583602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Launched 05:40:49.900185 run osmo-hlr_10.42.42.2(pid=29985): Launched 05:40:50.020004 run osmo-stp_10.42.42.5: Starting osmo-stp 05:40:50.579105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Launched 05:40:50.895981 run osmo-stp_10.42.42.5(pid=29988): Launched 05:40:51.015279 run osmo-msc_10.42.42.6: Starting osmo-msc 05:40:51.584796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29990): Launched 05:40:51.901202 run osmo-msc_10.42.42.6(pid=29991): Launched 05:40:52.077160 run osmo-stp_10.42.42.5(pid=29988): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] 05:40:52.211597 run osmo-stp_10.42.42.5(pid=29988): stdout: | (launched: 2022-12-09_05:40:50.835804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:52.345189 run osmo-stp_10.42.42.5(pid=29988): stderr: | 20221209054051010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054051010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054051010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054051010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054051011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054051011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054051011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:52.476478 run osmo-stp_10.42.42.5(pid=29988): stdout: | (launched: 2022-12-09_05:40:50.835804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:40:52.601777 run osmo-stp_10.42.42.5(pid=29988): stderr: | 20221209054051010 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054051010 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054051010 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054051010 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054051011 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054051011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054051011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:40:52.751591 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29988): Process ended prematurely: osmo-stp_10.42.42.5(pid=29988) [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:40:52.760570 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:40:52.787911 run osmo-hlr_10.42.42.2(pid=29985): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29985)] 05:40:52.836703 run osmo-hlr_10.42.42.2(pid=29985): stdout: | (launched: 2022-12-09_05:40:49.840673) 05:40:52.887312 run osmo-hlr_10.42.42.2(pid=29985): stderr: | 20221209054050021 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054050021 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054050021 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054050021 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054050021 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054050021 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054050034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054050042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054050042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054050042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:40:52.958147 run osmo-msc_10.42.42.6(pid=29991): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29991)] 05:40:53.007177 run osmo-msc_10.42.42.6(pid=29991): stdout: | (launched: 2022-12-09_05:40:51.841443) 05:40:53.057708 run osmo-msc_10.42.42.6(pid=29991): stderr: | 20221209054052120 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054052120 DLGLOBAL DEBUG validating counter group 0x7fe780e81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054052120 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054052120 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054052120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054052121 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054052122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054052123 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054052123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054052123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:40:53.108658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Terminating (SIGTERM) 05:40:53.149289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Terminating (SIGTERM) 05:40:53.190026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29990): Terminating (SIGTERM) 05:40:53.230940 --- ParallelTerminationStrategy: PID 29984 died... 05:40:53.250469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29984): Terminated: ok {rc=0} 05:40:53.295811 --- ParallelTerminationStrategy: PID 29987 died... 05:40:53.314790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29987): Terminated: ok {rc=0} 05:40:53.360237 --- ParallelTerminationStrategy: PID 29990 died... 05:40:53.379162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29990): Terminated: ok {rc=0} 05:40:53.464216 bus /sierra_3: Setting Powered False 05:40:54.564079 bus /sierra_3: Setting Powered False 05:40:55.681249 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:40:56.834189 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:56.846883 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:40:56.906332 tst mo_mt_call_osmux.py: using LAC 19316 05:40:57.038537 tst mo_mt_call_osmux.py: using RAC 191 05:40:57.172382 tst mo_mt_call_osmux.py: using CellId 19316 05:40:57.304633 tst mo_mt_call_osmux.py: using BVCI 19317 05:40:57.428456 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:57.440643 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:57.452363 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:57.464245 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:57.476150 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:40:57.488104 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:57.607659 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:40:57.730545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:40:58.224237 run create_hlr_db(pid=29993): Launched 05:40:58.345404 bus /sierra_2: Setting Powered False 05:40:59.407599 run create_hlr_db(pid=29993): Terminated: ok {rc=0} 05:40:59.869828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29995): Launched 05:41:00.209609 run osmo-hlr_10.42.42.2(pid=29996): Launched 05:41:00.339058 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:00.951092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29998): Launched 05:41:01.292000 run osmo-stp_10.42.42.5(pid=29999): Launched 05:41:01.609836 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:02.254235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30001): Launched 05:41:02.575613 run osmo-msc_10.42.42.6(pid=30002): Launched 05:41:02.753940 run osmo-stp_10.42.42.5(pid=29999): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29999)] 05:41:02.889286 run osmo-stp_10.42.42.5(pid=29999): stdout: | (launched: 2022-12-09_05:41:01.226964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:03.022581 run osmo-stp_10.42.42.5(pid=29999): stderr: | 20221209054101485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054101485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054101486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054101487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054101488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054101488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054101489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:03.154159 run osmo-stp_10.42.42.5(pid=29999): stdout: | (launched: 2022-12-09_05:41:01.226964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:03.279369 run osmo-stp_10.42.42.5(pid=29999): stderr: | 20221209054101485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054101485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054101486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054101487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054101488 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054101488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054101489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:03.428588 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29999): Process ended prematurely: osmo-stp_10.42.42.5(pid=29999) [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29999)] [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:41:03.437563 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:41:03.464814 run osmo-hlr_10.42.42.2(pid=29996): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29996)] 05:41:03.514336 run osmo-hlr_10.42.42.2(pid=29996): stdout: | (launched: 2022-12-09_05:41:00.146147) 05:41:03.564941 run osmo-hlr_10.42.42.2(pid=29996): stderr: | 20221209054100350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054100350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054100350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054100350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054100350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054100350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054100362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054100371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054100371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054100371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:03.635481 run osmo-msc_10.42.42.6(pid=30002): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30002)] 05:41:03.684182 run osmo-msc_10.42.42.6(pid=30002): stdout: | (launched: 2022-12-09_05:41:02.515077) 05:41:03.734678 run osmo-msc_10.42.42.6(pid=30002): stderr: | 20221209054102791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054102791 DLGLOBAL DEBUG validating counter group 0x7f0c25057c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054102791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054102791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054102791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054102792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054102793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054102794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054102794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054102794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:03.785626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29995): Terminating (SIGTERM) 05:41:03.826616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29998): Terminating (SIGTERM) 05:41:03.867725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30001): Terminating (SIGTERM) 05:41:03.909037 --- ParallelTerminationStrategy: PID 29995 died... 05:41:03.928931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29995): Terminated: ok {rc=0} 05:41:03.974525 --- ParallelTerminationStrategy: PID 29998 died... 05:41:03.993814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29998): Terminated: ok {rc=0} 05:41:04.039266 --- ParallelTerminationStrategy: PID 30001 died... 05:41:04.058070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30001): Terminated: ok {rc=0} 05:41:04.144224 bus /sierra_3: Setting Powered False 05:41:05.244020 bus /sierra_3: Setting Powered False 05:41:06.360015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:41:07.592880 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:07.598644 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:41:07.620057 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:41:07.647319 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:41:07.699137 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:41:07.719808 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:41:07.746669 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:41:08.294700 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:41:08.345992 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.356931 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:41:08.414350 tst mo_mt_call.py: using LAC 19317 05:41:08.539412 tst mo_mt_call.py: using RAC 192 05:41:08.664616 tst mo_mt_call.py: using CellId 19317 05:41:08.789122 tst mo_mt_call.py: using BVCI 19318 05:41:08.904835 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.915944 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.926640 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.937598 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.948662 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:08.959829 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:09.081562 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:09.200276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:09.691748 run create_hlr_db(pid=30007): Launched 05:41:09.811197 bus /sierra_2: Setting Powered False 05:41:10.874024 run create_hlr_db(pid=30007): Terminated: ok {rc=0} 05:41:11.313456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Launched 05:41:11.631464 run osmo-hlr_10.42.42.2(pid=30010): Launched 05:41:11.751100 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:12.308697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Launched 05:41:12.625579 run osmo-stp_10.42.42.5(pid=30013): Launched 05:41:12.745551 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:13.314018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30015): Launched 05:41:13.631449 run osmo-msc_10.42.42.6(pid=30016): Launched 05:41:13.807597 run osmo-stp_10.42.42.5(pid=30013): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] 05:41:13.941264 run osmo-stp_10.42.42.5(pid=30013): stdout: | (launched: 2022-12-09_05:41:12.565722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:14.073723 run osmo-stp_10.42.42.5(pid=30013): stderr: | 20221209054112743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054112744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054112744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054112744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054112745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054112745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054112745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:14.205188 run osmo-stp_10.42.42.5(pid=30013): stdout: | (launched: 2022-12-09_05:41:12.565722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:14.329353 run osmo-stp_10.42.42.5(pid=30013): stderr: | 20221209054112743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054112744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054112744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054112744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054112745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054112745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054112745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:14.478643 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30013): Process ended prematurely: osmo-stp_10.42.42.5(pid=30013) [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:41:14.487683 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:41:14.515298 run osmo-hlr_10.42.42.2(pid=30010): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30010)] 05:41:14.564071 run osmo-hlr_10.42.42.2(pid=30010): stdout: | (launched: 2022-12-09_05:41:11.571297) 05:41:14.614947 run osmo-hlr_10.42.42.2(pid=30010): stderr: | 20221209054111755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054111755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054111755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054111755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054111755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054111755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054111765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054111774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054111775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054111775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:14.686377 run osmo-msc_10.42.42.6(pid=30016): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30016)] 05:41:14.735800 run osmo-msc_10.42.42.6(pid=30016): stdout: | (launched: 2022-12-09_05:41:13.571216) 05:41:14.786954 run osmo-msc_10.42.42.6(pid=30016): stderr: | 20221209054113848 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054113848 DLGLOBAL DEBUG validating counter group 0x7f6d73e01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054113848 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054113848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054113848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054113849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054113850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054113851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054113851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054113851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:14.838135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminating (SIGTERM) 05:41:14.878925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Terminating (SIGTERM) 05:41:14.919589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30015): Terminating (SIGTERM) 05:41:14.960753 --- ParallelTerminationStrategy: PID 30009 died... 05:41:14.980360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30009): Terminated: ok {rc=0} 05:41:15.026598 --- ParallelTerminationStrategy: PID 30012 died... 05:41:15.045808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30012): Terminated: ok {rc=0} 05:41:15.091145 --- ParallelTerminationStrategy: PID 30015 died... 05:41:15.110188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30015): Terminated: ok {rc=0} 05:41:15.199102 bus /sierra_3: Setting Powered False 05:41:16.306398 bus /sierra_3: Setting Powered False 05:41:17.433651 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:41:18.585646 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:18.597701 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:41:18.656059 tst mo_mt_call_osmux.py: using LAC 19318 05:41:18.787764 tst mo_mt_call_osmux.py: using RAC 193 05:41:18.919428 tst mo_mt_call_osmux.py: using CellId 19318 05:41:19.051548 tst mo_mt_call_osmux.py: using BVCI 19319 05:41:19.173858 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:19.185297 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:19.196216 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:19.207555 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:19.218722 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:41:19.229914 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:19.345665 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:41:19.463285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:19.941801 run create_hlr_db(pid=30018): Launched 05:41:20.059174 bus /sierra_2: Setting Powered False 05:41:21.120396 run create_hlr_db(pid=30018): Terminated: ok {rc=0} 05:41:21.573555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Launched 05:41:21.908656 run osmo-hlr_10.42.42.2(pid=30021): Launched 05:41:22.034341 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:22.608539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Launched 05:41:22.940032 run osmo-stp_10.42.42.5(pid=30024): Launched 05:41:23.065224 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:23.667635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30026): Launched 05:41:24.001619 run osmo-msc_10.42.42.6(pid=30027): Launched 05:41:24.185983 run osmo-stp_10.42.42.5(pid=30024): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] 05:41:24.325481 run osmo-stp_10.42.42.5(pid=30024): stdout: | (launched: 2022-12-09_05:41:22.877826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:24.466154 run osmo-stp_10.42.42.5(pid=30024): stderr: | 20221209054123074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054123074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054123074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054123075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054123075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054123075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054123075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:24.604354 run osmo-stp_10.42.42.5(pid=30024): stdout: | (launched: 2022-12-09_05:41:22.877826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:24.735543 run osmo-stp_10.42.42.5(pid=30024): stderr: | 20221209054123074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054123074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054123074 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054123075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054123075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054123075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054123075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:24.892581 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30024): Process ended prematurely: osmo-stp_10.42.42.5(pid=30024) [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:41:24.902373 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:41:24.930608 run osmo-hlr_10.42.42.2(pid=30021): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30021)] 05:41:24.981275 run osmo-hlr_10.42.42.2(pid=30021): stdout: | (launched: 2022-12-09_05:41:21.846619) 05:41:25.033739 run osmo-hlr_10.42.42.2(pid=30021): stderr: | 20221209054122049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054122049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054122049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054122049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054122049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054122049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054122062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054122071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054122071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054122071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:25.106214 run osmo-msc_10.42.42.6(pid=30027): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30027)] 05:41:25.157158 run osmo-msc_10.42.42.6(pid=30027): stdout: | (launched: 2022-12-09_05:41:23.939695) 05:41:25.209493 run osmo-msc_10.42.42.6(pid=30027): stderr: | 20221209054124266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054124266 DLGLOBAL DEBUG validating counter group 0x7f0d1560dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054124266 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054124266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054124266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054124266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054124268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054124268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054124269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054124269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:25.261900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Terminating (SIGTERM) 05:41:25.303892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Terminating (SIGTERM) 05:41:25.346022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30026): Terminating (SIGTERM) 05:41:25.388593 --- ParallelTerminationStrategy: PID 30020 died... 05:41:25.408789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30020): Terminated: ok {rc=0} 05:41:25.455475 --- ParallelTerminationStrategy: PID 30023 died... 05:41:25.475281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30023): Terminated: ok {rc=0} 05:41:25.521758 --- ParallelTerminationStrategy: PID 30026 died... 05:41:25.542094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30026): Terminated: ok {rc=0} 05:41:25.630400 bus /sierra_3: Setting Powered False 05:41:26.731745 bus /sierra_3: Setting Powered False 05:41:27.851364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:oc2g --------------------------------------------------------------------- 05:41:29.082424 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:29.087081 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 05:41:29.108403 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 05:41:29.135136 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 05:41:29.218386 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 05:41:29.238567 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 05:41:29.265143 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 05:41:29.846954 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 05:41:29.851831 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:29.862383 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:41:29.897363 tst emergency_mo_mt_call.py: using LAC 19319 05:41:30.018706 tst emergency_mo_mt_call.py: using RAC 194 05:41:30.137649 tst emergency_mo_mt_call.py: using CellId 19319 05:41:30.256054 tst emergency_mo_mt_call.py: using BVCI 19320 05:41:30.365364 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:30.375940 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:30.386439 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:30.397631 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:30.408125 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:30.418859 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:30.536635 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:30.653811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:31.158951 run create_hlr_db(pid=30032): Launched 05:41:31.323691 bus /sierra_2: Setting Powered False 05:41:32.386852 run create_hlr_db(pid=30032): Terminated: ok {rc=0} 05:41:32.826700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Launched 05:41:33.130739 run osmo-hlr_10.42.42.2(pid=30035): Launched 05:41:33.244861 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:33.782737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Launched 05:41:34.085846 run osmo-stp_10.42.42.5(pid=30038): Launched 05:41:34.209439 tst emergency_mo_mt_call.py: using MSISDN 7049 05:41:34.379687 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:34.924685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30040): Launched 05:41:35.228722 run osmo-msc_10.42.42.6(pid=30041): Launched 05:41:35.398176 run osmo-stp_10.42.42.5(pid=30038): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] 05:41:35.527344 run osmo-stp_10.42.42.5(pid=30038): stdout: | (launched: 2022-12-09_05:41:34.028771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:35.656088 run osmo-stp_10.42.42.5(pid=30038): stderr: | 20221209054134200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054134200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054134201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054134201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054134204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054134204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054134204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:35.782649 run osmo-stp_10.42.42.5(pid=30038): stdout: | (launched: 2022-12-09_05:41:34.028771) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:35.902671 run osmo-stp_10.42.42.5(pid=30038): stderr: | 20221209054134200 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054134200 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054134201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054134201 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054134204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054134204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054134204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:36.046462 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30038): Process ended prematurely: osmo-stp_10.42.42.5(pid=30038) [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py:19] 05:41:36.054599 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 05:41:36.081421 run osmo-hlr_10.42.42.2(pid=30035): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30035)] 05:41:36.130015 run osmo-hlr_10.42.42.2(pid=30035): stdout: | (launched: 2022-12-09_05:41:33.072738) 05:41:36.179847 run osmo-hlr_10.42.42.2(pid=30035): stderr: | 20221209054133252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054133252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054133252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054133252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054133252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054133252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054133263 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054133272 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054133272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054133273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:36.249649 run osmo-msc_10.42.42.6(pid=30041): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30041)] 05:41:36.297944 run osmo-msc_10.42.42.6(pid=30041): stdout: | (launched: 2022-12-09_05:41:35.171149) 05:41:36.347823 run osmo-msc_10.42.42.6(pid=30041): stderr: | 20221209054135443 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054135443 DLGLOBAL DEBUG validating counter group 0x7f857d2a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054135443 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054135444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054135444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054135444 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054135447 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054135448 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054135449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054135449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:36.398199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Terminating (SIGTERM) 05:41:36.438335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Terminating (SIGTERM) 05:41:36.478518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30040): Terminating (SIGTERM) 05:41:36.519037 --- ParallelTerminationStrategy: PID 30034 died... 05:41:36.538310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Terminated: ok {rc=0} 05:41:36.583129 --- ParallelTerminationStrategy: PID 30037 died... 05:41:36.602038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Terminated: ok {rc=0} 05:41:36.646786 --- ParallelTerminationStrategy: PID 30040 died... 05:41:36.665680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30040): Terminated: ok {rc=0} 05:41:36.750253 bus /sierra_3: Setting Powered False 05:41:37.848858 bus /sierra_3: Setting Powered False 05:41:38.967436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 05:41:40.052168 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.063400 tst emergency:oc2g: Using 1 x bts (candidates: 1) 05:41:40.101359 tst emergency_preemptive_call.py: using LAC 19320 05:41:40.219611 tst emergency_preemptive_call.py: using RAC 195 05:41:40.337346 tst emergency_preemptive_call.py: using CellId 19320 05:41:40.454864 tst emergency_preemptive_call.py: using BVCI 19321 05:41:40.565612 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.576003 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.586375 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.597089 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.607689 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 05:41:40.618289 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:40.738572 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:40.856026 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:40.974104 tst emergency:oc2g: Using 1 x modem (candidates: 4) 05:41:41.089619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:41.561975 run create_hlr_db(pid=30043): Launched 05:41:41.677529 bus /sierra_2: Setting Powered False 05:41:42.737736 run create_hlr_db(pid=30043): Terminated: ok {rc=0} 05:41:43.183447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30045): Launched 05:41:43.510777 run osmo-hlr_10.42.42.2(pid=30046): Launched 05:41:43.634840 run osmo-stp_10.42.42.5: Starting osmo-stp 05:41:44.197403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30048): Launched 05:41:44.524319 run osmo-stp_10.42.42.5(pid=30049): Launched 05:41:44.657399 tst emergency_preemptive_call.py: using MSISDN 7050 05:41:44.821956 run osmo-msc_10.42.42.6: Starting osmo-msc 05:41:45.406335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30051): Launched 05:41:45.732428 run osmo-msc_10.42.42.6(pid=30052): Launched 05:41:45.975585 run osmo-stp_10.42.42.5(pid=30049): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30049)] 05:41:46.222149 run osmo-stp_10.42.42.5(pid=30049): stdout: | (launched: 2022-12-09_05:41:44.462800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:46.397501 run osmo-stp_10.42.42.5(pid=30049): stderr: | 20221209054144660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054144660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054144660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054144661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054144661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054144661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054144661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:46.577749 run osmo-stp_10.42.42.5(pid=30049): stdout: | (launched: 2022-12-09_05:41:44.462800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:41:46.704104 run osmo-stp_10.42.42.5(pid=30049): stderr: | 20221209054144660 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054144660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054144660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054144661 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054144661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054144661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054144661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:41:46.855170 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30049): Process ended prematurely: osmo-stp_10.42.42.5(pid=30049) [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30049)] [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py:32] 05:41:46.864425 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 05:41:46.894513 run osmo-hlr_10.42.42.2(pid=30046): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30046)] 05:41:46.946553 run osmo-hlr_10.42.42.2(pid=30046): stdout: | (launched: 2022-12-09_05:41:43.449737) 05:41:46.999604 run osmo-hlr_10.42.42.2(pid=30046): stderr: | 20221209054143652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054143652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054143652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054143652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054143652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054143652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054143664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054143672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054143672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054143672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:41:47.073239 run osmo-msc_10.42.42.6(pid=30052): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30052)] 05:41:47.125173 run osmo-msc_10.42.42.6(pid=30052): stdout: | (launched: 2022-12-09_05:41:45.671498) 05:41:47.182072 run osmo-msc_10.42.42.6(pid=30052): stderr: | 20221209054146148 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054146148 DLGLOBAL DEBUG validating counter group 0x7fae683fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054146148 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054146148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054146148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054146149 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054146150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054146151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054146151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054146151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:41:47.235206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30045): Terminating (SIGTERM) 05:41:47.278673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30048): Terminating (SIGTERM) 05:41:47.324454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30051): Terminating (SIGTERM) 05:41:47.373355 --- ParallelTerminationStrategy: PID 30045 died... 05:41:47.392390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30045): Terminated: ok {rc=0} 05:41:47.437030 --- ParallelTerminationStrategy: PID 30048 died... 05:41:47.455687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30048): Terminated: ok {rc=0} 05:41:47.500096 --- ParallelTerminationStrategy: PID 30051 died... 05:41:47.518759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30051): Terminated: ok {rc=0} 05:41:47.603124 bus /sierra_9: Setting Powered False 05:41:48.701085 bus /sierra_9: Setting Powered False 05:41:49.819014 bus /sierra_8: Setting Powered False 05:41:50.916917 bus /sierra_8: Setting Powered False 05:41:52.031610 bus /sierra_3: Setting Powered False 05:41:53.129284 bus /sierra_3: Setting Powered False 05:41:54.244409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:oc2g --------------------------------------------------------------------- 05:41:55.515009 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:41:55.520157 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 05:41:55.542383 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 05:41:55.580729 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 05:41:55.669241 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 05:41:55.690311 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 05:41:55.728445 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 05:41:56.313169 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 05:41:56.363277 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.373748 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:41:56.408459 tst cs_paging_gprs_active.py: using LAC 19321 05:41:56.527793 tst cs_paging_gprs_active.py: using RAC 196 05:41:56.647164 tst cs_paging_gprs_active.py: using CellId 19321 05:41:56.776906 tst cs_paging_gprs_active.py: using BVCI 19322 05:41:56.888481 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.899119 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.909461 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.920015 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.933627 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.944463 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.955739 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.966877 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:41:56.977926 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:57.091814 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:41:57.206771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:41:57.409269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:57.724786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Launched 05:41:57.987063 run iperf3-srv_10.42.42.10(pid=30058): Launched 05:41:58.100393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:41:58.301073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:41:58.601969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Launched 05:41:58.863738 run iperf3-srv_10.42.42.10(pid=30060): Launched 05:41:58.977214 tst cs_paging_gprs_active.py:38: start network... 05:41:59.177846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:41:59.642858 run create_hlr_db(pid=30061): Launched 05:41:59.756715 bus /sierra_2: Setting Powered False 05:42:00.817436 run create_hlr_db(pid=30061): Terminated: ok {rc=0} 05:42:01.345228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30067): Launched 05:42:01.690964 run osmo-hlr_10.42.42.2(pid=30068): Launched 05:42:01.943187 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:02.586276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30070): Launched 05:42:02.907740 run osmo-stp_10.42.42.5(pid=30071): Launched 05:42:03.031664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:03.587553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30073): Launched 05:42:03.710680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:03.982434 run patchelf(pid=30074): Launched 05:42:04.161262 run osmo-stp_10.42.42.5(pid=30071): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30071)] 05:42:04.297299 run osmo-stp_10.42.42.5(pid=30071): stdout: | (launched: 2022-12-09_05:42:02.849386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:04.435607 run osmo-stp_10.42.42.5(pid=30071): stderr: | 20221209054203043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054203044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054203044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054203044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054203045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054203045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054203045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:04.573797 run osmo-stp_10.42.42.5(pid=30071): stdout: | (launched: 2022-12-09_05:42:02.849386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:04.705933 run osmo-stp_10.42.42.5(pid=30071): stderr: | 20221209054203043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054203044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054203044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054203044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054203045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054203045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054203045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:04.862252 run patchelf(pid=30074): Terminating (SIGINT) 05:42:05.043410 run patchelf(pid=30074): Terminated: ok {rc=0} 05:42:05.174015 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30071): Process ended prematurely: osmo-stp_10.42.42.5(pid=30071) [trial-2355↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30071)] [trial-2355↪gprs:oc2g↪cs_paging_gprs_active.py:38] 05:42:05.183809 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:42:05.212414 run osmo-hlr_10.42.42.2(pid=30068): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30068)] 05:42:05.262705 run osmo-hlr_10.42.42.2(pid=30068): stdout: | (launched: 2022-12-09_05:42:01.625477) 05:42:05.314632 run osmo-hlr_10.42.42.2(pid=30068): stderr: | 20221209054201937 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054201937 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054201937 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054201938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054201938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054201938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054201957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054201965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054201966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054201966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:05.367056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminating (SIGTERM) 05:42:05.409214 run iperf3-srv_10.42.42.10(pid=30058): Terminating (SIGTERM) 05:42:05.451026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Terminating (SIGTERM) 05:42:05.492784 run iperf3-srv_10.42.42.10(pid=30060): Terminating (SIGTERM) 05:42:05.534503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30067): Terminating (SIGTERM) 05:42:05.576441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30070): Terminating (SIGTERM) 05:42:05.618338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30073): Terminating (SIGTERM) 05:42:05.660366 --- ParallelTerminationStrategy: PID 30057 died... 05:42:05.680308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30057): Terminated: ok {rc=0} 05:42:05.726441 --- ParallelTerminationStrategy: PID 30058 died... 05:42:05.745935 run iperf3-srv_10.42.42.10(pid=30058): Terminated {rc=256} 05:42:05.791604 --- ParallelTerminationStrategy: PID 30059 died... 05:42:05.811003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30059): Terminated: ok {rc=0} 05:42:05.856586 --- ParallelTerminationStrategy: PID 30060 died... 05:42:05.875920 run iperf3-srv_10.42.42.10(pid=30060): Terminated {rc=256} 05:42:05.922043 --- ParallelTerminationStrategy: PID 30067 died... 05:42:05.941550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30067): Terminated: ok {rc=0} 05:42:05.987765 --- ParallelTerminationStrategy: PID 30070 died... 05:42:06.007455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30070): Terminated: ok {rc=0} 05:42:06.053328 --- ParallelTerminationStrategy: PID 30073 died... 05:42:06.072804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30073): Terminated: ok {rc=0} 05:42:06.159832 bus /gobi_0: Setting Powered False 05:42:07.257474 bus /gobi_0: Setting Powered False 05:42:08.374413 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g iperf3.py ---------------------------------------------- 05:42:09.521905 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:09.533243 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:09.568916 tst iperf3.py: using LAC 19322 05:42:09.689305 tst iperf3.py: using RAC 197 05:42:09.816171 tst iperf3.py: using CellId 19322 05:42:09.943710 tst iperf3.py: using BVCI 19323 05:42:10.054879 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.065532 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.075697 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.086428 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.097263 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.107722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.118520 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.128918 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:10.139550 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:10.259355 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:10.479141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:10.802372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Launched 05:42:11.082579 run iperf3-srv_10.42.42.10(pid=30076): Launched 05:42:11.202988 tst iperf3.py:8: start network... 05:42:11.420433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:11.919058 run create_hlr_db(pid=30077): Launched 05:42:12.050357 bus /gobi_6: Setting Powered False 05:42:13.114162 run create_hlr_db(pid=30077): Terminated: ok {rc=0} 05:42:13.543194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Launched 05:42:13.842590 run osmo-hlr_10.42.42.2(pid=30080): Launched 05:42:13.956468 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:14.485475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Launched 05:42:14.785945 run osmo-stp_10.42.42.5(pid=30083): Launched 05:42:14.899515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:15.416215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Launched 05:42:15.531805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:15.784678 run patchelf(pid=30086): Launched 05:42:16.000170 run osmo-stp_10.42.42.5(pid=30083): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] 05:42:16.130995 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-09_05:42:14.729699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:16.263278 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221209054214901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054214901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054214902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054214902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054214902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054214903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054214903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:16.396230 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-09_05:42:14.729699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:16.524206 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221209054214901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054214901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054214902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054214902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054214902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054214903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054214903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:16.674820 run patchelf(pid=30086): Terminating (SIGINT) 05:42:16.848094 run patchelf(pid=30086): Terminated: ok {rc=0} 05:42:16.973568 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2355↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] [trial-2355↪gprs:oc2g↪iperf3.py:8] 05:42:16.983991 tst iperf3.py:8: Test FAILED (7.5 sec) 05:42:17.014652 run osmo-hlr_10.42.42.2(pid=30080): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30080)] 05:42:17.064920 run osmo-hlr_10.42.42.2(pid=30080): stdout: | (launched: 2022-12-09_05:42:13.788006) 05:42:17.116610 run osmo-hlr_10.42.42.2(pid=30080): stderr: | 20221209054213962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054213962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054213962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054213962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054213962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054213962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054213974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054213985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054213986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054213986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:17.169332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Terminating (SIGTERM) 05:42:17.210050 run iperf3-srv_10.42.42.10(pid=30076): Terminating (SIGTERM) 05:42:17.250737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminating (SIGTERM) 05:42:17.291480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminating (SIGTERM) 05:42:17.332167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminating (SIGTERM) 05:42:17.373086 --- ParallelTerminationStrategy: PID 30075 died... 05:42:17.392237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30075): Terminated: ok {rc=0} 05:42:17.437972 --- ParallelTerminationStrategy: PID 30076 died... 05:42:17.456598 run iperf3-srv_10.42.42.10(pid=30076): Terminated {rc=256} 05:42:17.502389 --- ParallelTerminationStrategy: PID 30079 died... 05:42:17.521260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminated: ok {rc=0} 05:42:17.566917 --- ParallelTerminationStrategy: PID 30082 died... 05:42:17.585726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminated: ok {rc=0} 05:42:17.631336 --- ParallelTerminationStrategy: PID 30085 died... 05:42:17.650198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30085): Terminated: ok {rc=0} 05:42:17.739352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g iperf3m4.py ---------------------------------------------- 05:42:18.885305 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:18.896426 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:18.932672 tst iperf3m4.py: using LAC 19323 05:42:19.050610 tst iperf3m4.py: using RAC 198 05:42:19.170442 tst iperf3m4.py: using CellId 19323 05:42:19.290559 tst iperf3m4.py: using BVCI 19324 05:42:19.402178 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.412738 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.423148 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.433849 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.443951 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.454796 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.465488 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.475927 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:19.486510 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:19.607700 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:19.723028 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:19.836628 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:19.953462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:42:20.153742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:20.454328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Launched 05:42:20.715120 run iperf3-srv_10.42.42.10(pid=30088): Launched 05:42:20.827347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:42:21.027325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:21.327083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Launched 05:42:21.587396 run iperf3-srv_10.42.42.10(pid=30090): Launched 05:42:21.699783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:42:21.899017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:22.199703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30091): Launched 05:42:22.459603 run iperf3-srv_10.42.42.10(pid=30092): Launched 05:42:22.571700 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:42:22.770698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:23.069556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30093): Launched 05:42:23.329470 run iperf3-srv_10.42.42.10(pid=30094): Launched 05:42:23.441617 tst iperf3m4.py:8: start network... 05:42:23.641677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:24.105342 run create_hlr_db(pid=30095): Launched 05:42:24.219477 bus /gobi_6: Setting Powered False 05:42:25.279586 run create_hlr_db(pid=30095): Terminated: ok {rc=0} 05:42:25.718558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Launched 05:42:26.039740 run osmo-hlr_10.42.42.2(pid=30098): Launched 05:42:26.163284 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:26.720088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Launched 05:42:27.041065 run osmo-stp_10.42.42.5(pid=30101): Launched 05:42:27.163782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:27.720512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Launched 05:42:27.843574 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:28.116675 run patchelf(pid=30104): Launched 05:42:28.296438 run osmo-stp_10.42.42.5(pid=30101): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] 05:42:28.433690 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-09_05:42:26.982723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:28.571837 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221209054227173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054227173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054227174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054227174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054227174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054227174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054227175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:28.710477 run osmo-stp_10.42.42.5(pid=30101): stdout: | (launched: 2022-12-09_05:42:26.982723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:28.843448 run osmo-stp_10.42.42.5(pid=30101): stderr: | 20221209054227173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054227173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054227174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054227174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054227174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054227174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054227175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:29.000848 run patchelf(pid=30104): Terminating (SIGINT) 05:42:29.181743 run patchelf(pid=30104): Terminated: ok {rc=0} 05:42:29.311593 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2355↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] [trial-2355↪gprs:oc2g↪iperf3m4.py:8] 05:42:29.321524 tst iperf3m4.py:8: Test FAILED (10.5 sec) 05:42:29.350175 run osmo-hlr_10.42.42.2(pid=30098): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30098)] 05:42:29.400219 run osmo-hlr_10.42.42.2(pid=30098): stdout: | (launched: 2022-12-09_05:42:25.981247) 05:42:29.452520 run osmo-hlr_10.42.42.2(pid=30098): stderr: | 20221209054226181 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054226181 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054226181 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054226181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054226181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054226181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054226194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054226202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054226202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054226202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:29.505124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminating (SIGTERM) 05:42:29.547203 run iperf3-srv_10.42.42.10(pid=30088): Terminating (SIGTERM) 05:42:29.589072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminating (SIGTERM) 05:42:29.631050 run iperf3-srv_10.42.42.10(pid=30090): Terminating (SIGTERM) 05:42:29.672884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30091): Terminating (SIGTERM) 05:42:29.714939 run iperf3-srv_10.42.42.10(pid=30092): Terminating (SIGTERM) 05:42:29.756694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30093): Terminating (SIGTERM) 05:42:29.799137 run iperf3-srv_10.42.42.10(pid=30094): Terminating (SIGTERM) 05:42:29.840917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminating (SIGTERM) 05:42:29.882804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminating (SIGTERM) 05:42:29.924711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Terminating (SIGTERM) 05:42:29.967321 --- ParallelTerminationStrategy: PID 30087 died... 05:42:29.987401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30087): Terminated: ok {rc=0} 05:42:30.033951 --- ParallelTerminationStrategy: PID 30088 died... 05:42:30.053548 run iperf3-srv_10.42.42.10(pid=30088): Terminated {rc=256} 05:42:30.100118 --- ParallelTerminationStrategy: PID 30089 died... 05:42:30.119812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30089): Terminated: ok {rc=0} 05:42:30.166782 --- ParallelTerminationStrategy: PID 30090 died... 05:42:30.186605 run iperf3-srv_10.42.42.10(pid=30090): Terminated {rc=256} 05:42:30.233090 --- ParallelTerminationStrategy: PID 30091 died... 05:42:30.252694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30091): Terminated: ok {rc=0} 05:42:30.299094 --- ParallelTerminationStrategy: PID 30092 died... 05:42:30.318919 run iperf3-srv_10.42.42.10(pid=30092): Terminated {rc=256} 05:42:30.365355 --- ParallelTerminationStrategy: PID 30093 died... 05:42:30.384793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30093): Terminated: ok {rc=0} 05:42:30.431796 --- ParallelTerminationStrategy: PID 30094 died... 05:42:30.451486 run iperf3-srv_10.42.42.10(pid=30094): Terminated {rc=256} 05:42:30.497781 --- ParallelTerminationStrategy: PID 30097 died... 05:42:30.517515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30097): Terminated: ok {rc=0} 05:42:30.563724 --- ParallelTerminationStrategy: PID 30100 died... 05:42:30.583301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30100): Terminated: ok {rc=0} 05:42:30.629525 --- ParallelTerminationStrategy: PID 30103 died... 05:42:30.649158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30103): Terminated: ok {rc=0} 05:42:30.736056 bus /gobi_4: Setting Powered False 05:42:31.842595 bus /gobi_4: Setting Powered False 05:42:32.970145 bus /gobi_1: Setting Powered False 05:42:34.068041 bus /gobi_1: Setting Powered False 05:42:35.185946 bus /gobi_0: Setting Powered False 05:42:36.283625 bus /gobi_0: Setting Powered False 05:42:37.400359 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g ping.py ---------------------------------------------- 05:42:38.503589 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:38.514665 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:38.553204 tst ping.py: using LAC 19324 05:42:38.669380 tst ping.py: using RAC 199 05:42:38.783413 tst ping.py: using CellId 19324 05:42:38.897381 tst ping.py: using BVCI 19325 05:42:39.004740 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.015290 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.025619 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.036064 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.046476 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.056835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.067433 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:39.077878 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:39.190661 tst ping.py:19: start network... 05:42:39.389280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:39.846298 run create_hlr_db(pid=30105): Launched 05:42:39.958749 bus /gobi_6: Setting Powered False 05:42:41.018910 run create_hlr_db(pid=30105): Terminated: ok {rc=0} 05:42:41.453413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Launched 05:42:41.769538 run osmo-hlr_10.42.42.2(pid=30108): Launched 05:42:41.890290 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:42.442677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Launched 05:42:42.759793 run osmo-stp_10.42.42.5(pid=30111): Launched 05:42:42.880327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:43.427465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30113): Launched 05:42:43.549639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:43.819623 run patchelf(pid=30120): Launched 05:42:43.985826 run osmo-stp_10.42.42.5(pid=30111): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30111)] 05:42:44.112820 run osmo-stp_10.42.42.5(pid=30111): stdout: | (launched: 2022-12-09_05:42:42.702096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:44.240478 run osmo-stp_10.42.42.5(pid=30111): stderr: | 20221209054242893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054242893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054242893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054242894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054242894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054242894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054242894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:44.368486 run osmo-stp_10.42.42.5(pid=30111): stdout: | (launched: 2022-12-09_05:42:42.702096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:44.490052 run osmo-stp_10.42.42.5(pid=30111): stderr: | 20221209054242893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054242893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054242893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054242894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054242894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054242894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054242894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:44.634238 run patchelf(pid=30120): Terminating (SIGINT) 05:42:44.800181 run patchelf(pid=30120): Terminated: ok {rc=0} 05:42:44.919744 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30111): Process ended prematurely: osmo-stp_10.42.42.5(pid=30111) [trial-2355↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30111)] [trial-2355↪gprs:oc2g↪ping.py:22] 05:42:44.928409 tst ping.py:22: Test FAILED (6.4 sec) 05:42:44.955580 run osmo-hlr_10.42.42.2(pid=30108): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30108)] 05:42:45.003988 run osmo-hlr_10.42.42.2(pid=30108): stdout: | (launched: 2022-12-09_05:42:41.712227) 05:42:45.053862 run osmo-hlr_10.42.42.2(pid=30108): stderr: | 20221209054241912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054241912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054241912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054241912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054241912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054241912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054241925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054241933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054241933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054241933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:45.104048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Terminating (SIGTERM) 05:42:45.144457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Terminating (SIGTERM) 05:42:45.184716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30113): Terminating (SIGTERM) 05:42:45.225236 --- ParallelTerminationStrategy: PID 30107 died... 05:42:45.244464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30107): Terminated: ok {rc=0} 05:42:45.289411 --- ParallelTerminationStrategy: PID 30110 died... 05:42:45.308094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30110): Terminated: ok {rc=0} 05:42:45.353268 --- ParallelTerminationStrategy: PID 30113 died... 05:42:45.371978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30113): Terminated: ok {rc=0} 05:42:45.456299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 05:42:46.550785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:46.569836 tst gprs:oc2g: Using 1 x bts (candidates: 1) 05:42:46.618456 tst ping_idle_ping.py: using LAC 19325 05:42:46.771868 tst ping_idle_ping.py: using RAC 200 05:42:46.887902 tst ping_idle_ping.py: using CellId 19325 05:42:47.003767 tst ping_idle_ping.py: using BVCI 19326 05:42:47.112792 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.123914 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.134840 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.146230 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.157449 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.168707 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.180133 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 05:42:47.191360 tst gprs:oc2g: Using 1 x modem (candidates: 4) 05:42:47.307564 tst ping_idle_ping.py:24: start network... 05:42:47.506369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:47.967475 run create_hlr_db(pid=30121): Launched 05:42:48.080654 bus /gobi_6: Setting Powered False 05:42:49.140244 run create_hlr_db(pid=30121): Terminated: ok {rc=0} 05:42:49.574582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Launched 05:42:49.893621 run osmo-hlr_10.42.42.2(pid=30124): Launched 05:42:50.015277 run osmo-stp_10.42.42.5: Starting osmo-stp 05:42:50.564679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Launched 05:42:50.861983 run osmo-stp_10.42.42.5(pid=30127): Launched 05:42:50.974159 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:42:51.484753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30129): Launched 05:42:51.598350 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:42:51.847186 run patchelf(pid=30130): Launched 05:42:52.012785 run osmo-stp_10.42.42.5(pid=30127): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] 05:42:52.138811 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-09_05:42:50.807411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:52.266543 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221209054250975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054250975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054250975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054250976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054250978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054250978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054250978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:52.394266 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-09_05:42:50.807411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:42:52.515691 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221209054250975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054250975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054250975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054250976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054250978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054250978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054250978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:42:52.659418 run patchelf(pid=30130): Terminating (SIGINT) 05:42:52.826638 run patchelf(pid=30130): Terminated: ok {rc=0} 05:42:52.947122 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2355↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] [trial-2355↪gprs:oc2g↪ping_idle_ping.py:27] 05:42:52.955861 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:42:52.983173 run osmo-hlr_10.42.42.2(pid=30124): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30124)] 05:42:53.031195 run osmo-hlr_10.42.42.2(pid=30124): stdout: | (launched: 2022-12-09_05:42:49.836031) 05:42:53.080524 run osmo-hlr_10.42.42.2(pid=30124): stderr: | 20221209054250032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054250032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054250032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054250032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054250032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054250032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054250044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054250052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054250053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054250053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:42:53.130512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminating (SIGTERM) 05:42:53.170508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminating (SIGTERM) 05:42:53.210588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30129): Terminating (SIGTERM) 05:42:53.250995 --- ParallelTerminationStrategy: PID 30123 died... 05:42:53.270024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminated: ok {rc=0} 05:42:53.314395 --- ParallelTerminationStrategy: PID 30126 died... 05:42:53.333135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminated: ok {rc=0} 05:42:53.377411 --- ParallelTerminationStrategy: PID 30129 died... 05:42:53.395980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30129): Terminated: ok {rc=0} 05:42:53.480034 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 05:42:54.770509 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:42:54.776337 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:42:54.797142 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:42:54.835874 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:42:54.923571 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:42:54.944330 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:42:54.982987 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:42:55.575676 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:42:55.625988 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:55.636902 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:42:55.673134 tst cs_paging_gprs_active.py: using LAC 19326 05:42:55.797368 tst cs_paging_gprs_active.py: using RAC 201 05:42:55.924744 tst cs_paging_gprs_active.py: using CellId 19326 05:42:56.048709 tst cs_paging_gprs_active.py: using BVCI 19327 05:42:56.163531 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.174861 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.185717 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.196469 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.207164 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.217895 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.229022 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.239907 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:42:56.250870 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:56.367087 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:42:56.480692 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:42:56.680734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:56.978654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30134): Launched 05:42:57.236278 run iperf3-srv_10.42.42.10(pid=30135): Launched 05:42:57.347754 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:42:57.545882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:42:57.842942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Launched 05:42:58.101284 run iperf3-srv_10.42.42.10(pid=30137): Launched 05:42:58.212673 tst cs_paging_gprs_active.py:38: start network... 05:42:58.410501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:42:58.870464 run create_hlr_db(pid=30138): Launched 05:42:58.984364 bus /gobi_6: Setting Powered False 05:43:00.044556 run create_hlr_db(pid=30138): Terminated: ok {rc=0} 05:43:00.459656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Launched 05:43:00.755564 run osmo-hlr_10.42.42.2(pid=30141): Launched 05:43:00.868075 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:01.614721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Launched 05:43:01.950886 run osmo-stp_10.42.42.5(pid=30144): Launched 05:43:02.196822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:02.754006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Launched 05:43:02.875465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:03.143397 run patchelf(pid=30147): Launched 05:43:03.320745 run osmo-stp_10.42.42.5(pid=30144): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] 05:43:03.457073 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-09_05:43:01.888753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:03.593866 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221209054302187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054302188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054302188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054302188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054302190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054302191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054302191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:03.731022 run osmo-stp_10.42.42.5(pid=30144): stdout: | (launched: 2022-12-09_05:43:01.888753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:03.861873 run osmo-stp_10.42.42.5(pid=30144): stderr: | 20221209054302187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054302188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054302188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054302188 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054302190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054302191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054302191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:04.017136 run patchelf(pid=30147): Terminating (SIGINT) 05:43:04.195051 run patchelf(pid=30147): Terminated: ok {rc=0} 05:43:04.323829 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] [trial-2355↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:43:04.334090 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 05:43:04.362270 run osmo-hlr_10.42.42.2(pid=30141): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30141)] 05:43:04.412449 run osmo-hlr_10.42.42.2(pid=30141): stdout: | (launched: 2022-12-09_05:43:00.701530) 05:43:04.465394 run osmo-hlr_10.42.42.2(pid=30141): stderr: | 20221209054300957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054300957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054300957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054300957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054300958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054300958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054300980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054301005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054301005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054301005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:04.517914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30134): Terminating (SIGTERM) 05:43:04.560033 run iperf3-srv_10.42.42.10(pid=30135): Terminating (SIGTERM) 05:43:04.602243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Terminating (SIGTERM) 05:43:04.644446 run iperf3-srv_10.42.42.10(pid=30137): Terminating (SIGTERM) 05:43:04.686566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminating (SIGTERM) 05:43:04.728645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminating (SIGTERM) 05:43:04.770899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminating (SIGTERM) 05:43:04.813238 --- ParallelTerminationStrategy: PID 30134 died... 05:43:04.833313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30134): Terminated: ok {rc=0} 05:43:04.879835 --- ParallelTerminationStrategy: PID 30135 died... 05:43:04.899365 run iperf3-srv_10.42.42.10(pid=30135): Terminated {rc=256} 05:43:04.945360 --- ParallelTerminationStrategy: PID 30136 died... 05:43:04.964763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30136): Terminated: ok {rc=0} 05:43:05.011110 --- ParallelTerminationStrategy: PID 30137 died... 05:43:05.030526 run iperf3-srv_10.42.42.10(pid=30137): Terminated {rc=256} 05:43:05.076777 --- ParallelTerminationStrategy: PID 30140 died... 05:43:05.096355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30140): Terminated: ok {rc=0} 05:43:05.142461 --- ParallelTerminationStrategy: PID 30143 died... 05:43:05.162121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30143): Terminated: ok {rc=0} 05:43:05.208143 --- ParallelTerminationStrategy: PID 30146 died... 05:43:05.227980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30146): Terminated: ok {rc=0} 05:43:05.315042 bus /gobi_0: Setting Powered False 05:43:06.413349 bus /gobi_0: Setting Powered False 05:43:07.529125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:43:08.673598 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:08.685065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:08.721874 tst iperf3.py: using LAC 19327 05:43:08.837353 tst iperf3.py: using RAC 202 05:43:08.956502 tst iperf3.py: using CellId 19327 05:43:09.072930 tst iperf3.py: using BVCI 19328 05:43:09.182266 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.192859 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.203443 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.214355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.224996 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.235277 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.246281 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.257042 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:09.267812 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:09.382448 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:09.579653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:09.876436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Launched 05:43:10.134066 run iperf3-srv_10.42.42.10(pid=30149): Launched 05:43:10.244659 tst iperf3.py:8: start network... 05:43:10.441561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:10.899114 run create_hlr_db(pid=30150): Launched 05:43:11.011767 bus /gobi_6: Setting Powered False 05:43:12.071388 run create_hlr_db(pid=30150): Terminated: ok {rc=0} 05:43:12.504851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30152): Launched 05:43:12.821045 run osmo-hlr_10.42.42.2(pid=30153): Launched 05:43:12.942727 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:13.492370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30155): Launched 05:43:13.809379 run osmo-stp_10.42.42.5(pid=30156): Launched 05:43:13.930601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:14.477612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30158): Launched 05:43:14.598622 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:14.865344 run patchelf(pid=30159): Launched 05:43:15.041686 run osmo-stp_10.42.42.5(pid=30156): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30156)] 05:43:15.176723 run osmo-stp_10.42.42.5(pid=30156): stdout: | (launched: 2022-12-09_05:43:13.752137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:15.313331 run osmo-stp_10.42.42.5(pid=30156): stderr: | 20221209054313945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054313945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054313945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054313946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054313946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054313946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054313946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:15.450126 run osmo-stp_10.42.42.5(pid=30156): stdout: | (launched: 2022-12-09_05:43:13.752137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:15.581468 run osmo-stp_10.42.42.5(pid=30156): stderr: | 20221209054313945 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054313945 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054313945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054313946 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054313946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054313946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054313946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:15.736869 run patchelf(pid=30159): Terminating (SIGINT) 05:43:15.924127 run patchelf(pid=30159): Terminated: ok {rc=0} 05:43:16.054716 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30156): Process ended prematurely: osmo-stp_10.42.42.5(pid=30156) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30156)] [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 05:43:16.065843 tst iperf3.py:8: Test FAILED (7.4 sec) 05:43:16.095313 run osmo-hlr_10.42.42.2(pid=30153): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30153)] 05:43:16.146159 run osmo-hlr_10.42.42.2(pid=30153): stdout: | (launched: 2022-12-09_05:43:12.764005) 05:43:16.199864 run osmo-hlr_10.42.42.2(pid=30153): stderr: | 20221209054312960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054312960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054312961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054312961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054312961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054312961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054312974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054312982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054312982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054312982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:16.253885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Terminating (SIGTERM) 05:43:16.298248 run iperf3-srv_10.42.42.10(pid=30149): Terminating (SIGTERM) 05:43:16.344555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30152): Terminating (SIGTERM) 05:43:16.388462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30155): Terminating (SIGTERM) 05:43:16.432793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30158): Terminating (SIGTERM) 05:43:16.478396 --- ParallelTerminationStrategy: PID 30148 died... 05:43:16.498797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30148): Terminated: ok {rc=0} 05:43:16.547424 --- ParallelTerminationStrategy: PID 30149 died... 05:43:16.567835 run iperf3-srv_10.42.42.10(pid=30149): Terminated {rc=256} 05:43:16.615780 --- ParallelTerminationStrategy: PID 30152 died... 05:43:16.636150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30152): Terminated: ok {rc=0} 05:43:16.684489 --- ParallelTerminationStrategy: PID 30155 died... 05:43:16.705063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30155): Terminated: ok {rc=0} 05:43:16.753397 --- ParallelTerminationStrategy: PID 30158 died... 05:43:16.773815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30158): Terminated: ok {rc=0} 05:43:16.865151 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:43:18.015219 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.026940 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:18.062190 tst iperf3m4.py: using LAC 19328 05:43:18.184597 tst iperf3m4.py: using RAC 203 05:43:18.311710 tst iperf3m4.py: using CellId 19328 05:43:18.435210 tst iperf3m4.py: using BVCI 19329 05:43:18.550677 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.562126 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.573057 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.584004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.594792 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.605616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.616644 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.627495 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:18.638573 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:18.754403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:18.874605 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:18.988260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:19.107118 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:43:19.321537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:19.641076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Launched 05:43:19.915688 run iperf3-srv_10.42.42.10(pid=30161): Launched 05:43:20.034881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:43:20.248757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:20.566422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Launched 05:43:20.841516 run iperf3-srv_10.42.42.10(pid=30163): Launched 05:43:20.960296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:43:21.173603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:21.490898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30164): Launched 05:43:21.765965 run iperf3-srv_10.42.42.10(pid=30165): Launched 05:43:21.885238 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:43:22.097983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:22.415489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30166): Launched 05:43:22.692828 run iperf3-srv_10.42.42.10(pid=30167): Launched 05:43:22.811502 tst iperf3m4.py:8: start network... 05:43:23.023897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:23.517280 run create_hlr_db(pid=30168): Launched 05:43:23.645260 bus /gobi_6: Setting Powered False 05:43:24.708604 run create_hlr_db(pid=30168): Terminated: ok {rc=0} 05:43:25.150846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Launched 05:43:25.468426 run osmo-hlr_10.42.42.2(pid=30171): Launched 05:43:25.589616 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:26.136300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Launched 05:43:26.454634 run osmo-stp_10.42.42.5(pid=30174): Launched 05:43:26.576284 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:27.125847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Launched 05:43:27.248809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:27.518329 run patchelf(pid=30177): Launched 05:43:27.695391 run osmo-stp_10.42.42.5(pid=30174): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] 05:43:27.830742 run osmo-stp_10.42.42.5(pid=30174): stdout: | (launched: 2022-12-09_05:43:26.396561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:27.967750 run osmo-stp_10.42.42.5(pid=30174): stderr: | 20221209054326589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054326590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054326590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054326590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054326591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054326591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054326591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:28.104330 run osmo-stp_10.42.42.5(pid=30174): stdout: | (launched: 2022-12-09_05:43:26.396561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:28.235948 run osmo-stp_10.42.42.5(pid=30174): stderr: | 20221209054326589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054326590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054326590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054326590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054326591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054326591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054326591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:28.391596 run patchelf(pid=30177): Terminating (SIGINT) 05:43:28.570474 run patchelf(pid=30177): Terminated: ok {rc=0} 05:43:28.699710 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30174): Process ended prematurely: osmo-stp_10.42.42.5(pid=30174) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 05:43:28.709701 tst iperf3m4.py:8: Test FAILED (10.7 sec) 05:43:28.738074 run osmo-hlr_10.42.42.2(pid=30171): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30171)] 05:43:28.788006 run osmo-hlr_10.42.42.2(pid=30171): stdout: | (launched: 2022-12-09_05:43:25.410370) 05:43:28.839738 run osmo-hlr_10.42.42.2(pid=30171): stderr: | 20221209054325608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054325608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054325608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054325608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054325608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054325608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054325625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054325635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054325635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054325635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:28.891656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Terminating (SIGTERM) 05:43:28.933661 run iperf3-srv_10.42.42.10(pid=30161): Terminating (SIGTERM) 05:43:28.975414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Terminating (SIGTERM) 05:43:29.017289 run iperf3-srv_10.42.42.10(pid=30163): Terminating (SIGTERM) 05:43:29.058945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30164): Terminating (SIGTERM) 05:43:29.100775 run iperf3-srv_10.42.42.10(pid=30165): Terminating (SIGTERM) 05:43:29.142411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30166): Terminating (SIGTERM) 05:43:29.184147 run iperf3-srv_10.42.42.10(pid=30167): Terminating (SIGTERM) 05:43:29.225895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Terminating (SIGTERM) 05:43:29.267583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Terminating (SIGTERM) 05:43:29.309474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Terminating (SIGTERM) 05:43:29.351460 --- ParallelTerminationStrategy: PID 30160 died... 05:43:29.371353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Terminated: ok {rc=0} 05:43:29.417595 --- ParallelTerminationStrategy: PID 30161 died... 05:43:29.437335 run iperf3-srv_10.42.42.10(pid=30161): Terminated {rc=256} 05:43:29.483474 --- ParallelTerminationStrategy: PID 30162 died... 05:43:29.502973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Terminated: ok {rc=0} 05:43:29.549055 --- ParallelTerminationStrategy: PID 30163 died... 05:43:29.568408 run iperf3-srv_10.42.42.10(pid=30163): Terminated {rc=256} 05:43:29.614855 --- ParallelTerminationStrategy: PID 30164 died... 05:43:29.634223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30164): Terminated: ok {rc=0} 05:43:29.679908 --- ParallelTerminationStrategy: PID 30165 died... 05:43:29.699429 run iperf3-srv_10.42.42.10(pid=30165): Terminated {rc=256} 05:43:29.745264 --- ParallelTerminationStrategy: PID 30166 died... 05:43:29.764601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30166): Terminated: ok {rc=0} 05:43:29.810287 --- ParallelTerminationStrategy: PID 30167 died... 05:43:29.829689 run iperf3-srv_10.42.42.10(pid=30167): Terminated {rc=256} 05:43:29.875466 --- ParallelTerminationStrategy: PID 30170 died... 05:43:29.894807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30170): Terminated: ok {rc=0} 05:43:29.940553 --- ParallelTerminationStrategy: PID 30173 died... 05:43:29.960057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30173): Terminated: ok {rc=0} 05:43:30.005924 --- ParallelTerminationStrategy: PID 30176 died... 05:43:30.025449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30176): Terminated: ok {rc=0} 05:43:30.113199 bus /gobi_4: Setting Powered False 05:43:31.211881 bus /gobi_4: Setting Powered False 05:43:32.329722 bus /gobi_1: Setting Powered False 05:43:33.428036 bus /gobi_1: Setting Powered False 05:43:34.542862 bus /gobi_0: Setting Powered False 05:43:35.641259 bus /gobi_0: Setting Powered False 05:43:36.759173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 05:43:37.862503 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:37.873654 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:37.910762 tst ping.py: using LAC 19329 05:43:38.026380 tst ping.py: using RAC 204 05:43:38.139353 tst ping.py: using CellId 19329 05:43:38.254466 tst ping.py: using BVCI 19330 05:43:38.361168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.371760 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.382304 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.392928 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.403569 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.414162 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.425049 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:38.435755 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:38.548758 tst ping.py:19: start network... 05:43:38.742806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:39.190807 run create_hlr_db(pid=30178): Launched 05:43:39.300594 bus /gobi_6: Setting Powered False 05:43:40.359118 run create_hlr_db(pid=30178): Terminated: ok {rc=0} 05:43:40.766020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30180): Launched 05:43:41.055445 run osmo-hlr_10.42.42.2(pid=30181): Launched 05:43:41.165263 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:41.677161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30183): Launched 05:43:41.967521 run osmo-stp_10.42.42.5(pid=30184): Launched 05:43:42.078300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:42.580935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30186): Launched 05:43:42.692415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:42.937965 run patchelf(pid=30187): Launched 05:43:43.100521 run osmo-stp_10.42.42.5(pid=30184): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30184)] 05:43:43.224602 run osmo-stp_10.42.42.5(pid=30184): stdout: | (launched: 2022-12-09_05:43:41.914670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:43.350155 run osmo-stp_10.42.42.5(pid=30184): stderr: | 20221209054342084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054342084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054342084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054342085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054342085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054342085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054342085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:43.475924 run osmo-stp_10.42.42.5(pid=30184): stdout: | (launched: 2022-12-09_05:43:41.914670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:43.595647 run osmo-stp_10.42.42.5(pid=30184): stderr: | 20221209054342084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054342084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054342084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054342085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054342085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054342085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054342085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:43.738177 run patchelf(pid=30187): Terminating (SIGINT) 05:43:43.903662 run patchelf(pid=30187): Terminated: ok {rc=0} 05:43:44.022497 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30184): Process ended prematurely: osmo-stp_10.42.42.5(pid=30184) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30184)] [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 05:43:44.031566 tst ping.py:22: Test FAILED (6.2 sec) 05:43:44.058374 run osmo-hlr_10.42.42.2(pid=30181): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30181)] 05:43:44.106495 run osmo-hlr_10.42.42.2(pid=30181): stdout: | (launched: 2022-12-09_05:43:41.002887) 05:43:44.156122 run osmo-hlr_10.42.42.2(pid=30181): stderr: | 20221209054341177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054341177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054341177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054341177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054341177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054341177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054341192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054341202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054341202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054341202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:44.205999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30180): Terminating (SIGTERM) 05:43:44.246071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30183): Terminating (SIGTERM) 05:43:44.286254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30186): Terminating (SIGTERM) 05:43:44.326513 --- ParallelTerminationStrategy: PID 30180 died... 05:43:44.345539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30180): Terminated: ok {rc=0} 05:43:44.390614 --- ParallelTerminationStrategy: PID 30183 died... 05:43:44.409266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30183): Terminated: ok {rc=0} 05:43:44.454034 --- ParallelTerminationStrategy: PID 30186 died... 05:43:44.472484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30186): Terminated: ok {rc=0} 05:43:44.557188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:43:45.643883 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:45.656160 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:43:45.696824 tst ping_idle_ping.py: using LAC 19330 05:43:45.821114 tst ping_idle_ping.py: using RAC 205 05:43:45.966626 tst ping_idle_ping.py: using CellId 19330 05:43:46.093442 tst ping_idle_ping.py: using BVCI 19331 05:43:46.236773 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.248721 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.260589 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.272904 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.285356 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.297260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.309577 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:43:46.321911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:43:46.442253 tst ping_idle_ping.py:24: start network... 05:43:46.687315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:47.168037 run create_hlr_db(pid=30188): Launched 05:43:47.289889 bus /gobi_6: Setting Powered False 05:43:48.352248 run create_hlr_db(pid=30188): Terminated: ok {rc=0} 05:43:48.773050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30190): Launched 05:43:49.066253 run osmo-hlr_10.42.42.2(pid=30191): Launched 05:43:49.177022 run osmo-stp_10.42.42.5: Starting osmo-stp 05:43:49.690952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30193): Launched 05:43:49.983703 run osmo-stp_10.42.42.5(pid=30194): Launched 05:43:50.096458 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:43:50.601034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30196): Launched 05:43:50.714077 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:43:50.961821 run patchelf(pid=30197): Launched 05:43:51.125884 run osmo-stp_10.42.42.5(pid=30194): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30194)] 05:43:51.251516 run osmo-stp_10.42.42.5(pid=30194): stdout: | (launched: 2022-12-09_05:43:49.930219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:51.377966 run osmo-stp_10.42.42.5(pid=30194): stderr: | 20221209054350098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054350098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054350098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054350099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054350099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054350099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054350099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:51.504901 run osmo-stp_10.42.42.5(pid=30194): stdout: | (launched: 2022-12-09_05:43:49.930219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:43:51.625839 run osmo-stp_10.42.42.5(pid=30194): stderr: | 20221209054350098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054350098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054350098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054350099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054350099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054350099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054350099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:43:51.768738 run patchelf(pid=30197): Terminating (SIGINT) 05:43:51.934316 run patchelf(pid=30197): Terminated: ok {rc=0} 05:43:52.053502 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30194): Process ended prematurely: osmo-stp_10.42.42.5(pid=30194) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30194)] [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 05:43:52.062280 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:43:52.089456 run osmo-hlr_10.42.42.2(pid=30191): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30191)] 05:43:52.138482 run osmo-hlr_10.42.42.2(pid=30191): stdout: | (launched: 2022-12-09_05:43:49.012793) 05:43:52.188658 run osmo-hlr_10.42.42.2(pid=30191): stderr: | 20221209054349186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054349186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054349186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054349186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054349186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054349186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054349199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054349209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054349209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054349210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:43:52.239578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30190): Terminating (SIGTERM) 05:43:52.280447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30193): Terminating (SIGTERM) 05:43:52.321204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30196): Terminating (SIGTERM) 05:43:52.362786 --- ParallelTerminationStrategy: PID 30190 died... 05:43:52.382274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30190): Terminated: ok {rc=0} 05:43:52.427476 --- ParallelTerminationStrategy: PID 30193 died... 05:43:52.446569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30193): Terminated: ok {rc=0} 05:43:52.491745 --- ParallelTerminationStrategy: PID 30196 died... 05:43:52.510798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30196): Terminated: ok {rc=0} 05:43:52.595783 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:43:53.890436 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:43:53.896736 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:43:53.918348 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:43:53.958109 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:43:54.045294 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:43:54.066190 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:43:54.105001 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:43:54.700235 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:43:54.751045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:54.762239 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:43:54.822069 tst cs_paging_gprs_active.py: using LAC 19331 05:43:54.947405 tst cs_paging_gprs_active.py: using RAC 206 05:43:55.070337 tst cs_paging_gprs_active.py: using CellId 19331 05:43:55.194258 tst cs_paging_gprs_active.py: using BVCI 19332 05:43:55.310140 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.321474 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.332412 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.343436 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.354285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.365189 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.376200 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.387021 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:43:55.398070 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:55.514311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:43:55.632773 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:43:55.849786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:56.170199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30201): Launched 05:43:56.446834 run iperf3-srv_10.42.42.10(pid=30202): Launched 05:43:56.566677 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:43:56.780924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:43:57.101290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30203): Launched 05:43:57.377922 run iperf3-srv_10.42.42.10(pid=30204): Launched 05:43:57.491550 tst cs_paging_gprs_active.py:38: start network... 05:43:57.690441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:43:58.151971 run create_hlr_db(pid=30205): Launched 05:43:58.265818 bus /gobi_6: Setting Powered False 05:43:59.325444 run create_hlr_db(pid=30205): Terminated: ok {rc=0} 05:43:59.761722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30207): Launched 05:44:00.078768 run osmo-hlr_10.42.42.2(pid=30208): Launched 05:44:00.200490 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:00.750591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30210): Launched 05:44:01.106561 run osmo-stp_10.42.42.5(pid=30211): Launched 05:44:01.343842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:02.011492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30213): Launched 05:44:02.133688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:02.389339 run patchelf(pid=30214): Launched 05:44:02.555418 run osmo-stp_10.42.42.5(pid=30211): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30211)] 05:44:02.682104 run osmo-stp_10.42.42.5(pid=30211): stdout: | (launched: 2022-12-09_05:44:01.035033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:02.810438 run osmo-stp_10.42.42.5(pid=30211): stderr: | 20221209054401365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054401365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054401366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054401366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054401366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054401367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054401367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:02.939839 run osmo-stp_10.42.42.5(pid=30211): stdout: | (launched: 2022-12-09_05:44:01.035033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:03.062624 run osmo-stp_10.42.42.5(pid=30211): stderr: | 20221209054401365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054401365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054401366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054401366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054401366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054401367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054401367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:03.207604 run patchelf(pid=30214): Terminating (SIGINT) 05:44:03.375330 run patchelf(pid=30214): Terminated: ok {rc=0} 05:44:03.496640 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30211): Process ended prematurely: osmo-stp_10.42.42.5(pid=30211) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30211)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:44:03.505925 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:44:03.533346 run osmo-hlr_10.42.42.2(pid=30208): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30208)] 05:44:03.581525 run osmo-hlr_10.42.42.2(pid=30208): stdout: | (launched: 2022-12-09_05:44:00.021319) 05:44:03.631286 run osmo-hlr_10.42.42.2(pid=30208): stderr: | 20221209054400220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054400220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054400220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054400220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054400220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054400220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054400232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054400240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054400241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054400241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:03.682027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30201): Terminating (SIGTERM) 05:44:03.722250 run iperf3-srv_10.42.42.10(pid=30202): Terminating (SIGTERM) 05:44:03.762572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30203): Terminating (SIGTERM) 05:44:03.803025 run iperf3-srv_10.42.42.10(pid=30204): Terminating (SIGTERM) 05:44:03.843207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30207): Terminating (SIGTERM) 05:44:03.883758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30210): Terminating (SIGTERM) 05:44:03.924107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30213): Terminating (SIGTERM) 05:44:03.964503 --- ParallelTerminationStrategy: PID 30201 died... 05:44:03.983702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30201): Terminated: ok {rc=0} 05:44:04.028398 --- ParallelTerminationStrategy: PID 30202 died... 05:44:04.047062 run iperf3-srv_10.42.42.10(pid=30202): Terminated {rc=256} 05:44:04.091910 --- ParallelTerminationStrategy: PID 30203 died... 05:44:04.110682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30203): Terminated: ok {rc=0} 05:44:04.155064 --- ParallelTerminationStrategy: PID 30204 died... 05:44:04.173671 run iperf3-srv_10.42.42.10(pid=30204): Terminated {rc=256} 05:44:04.217919 --- ParallelTerminationStrategy: PID 30207 died... 05:44:04.236741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30207): Terminated: ok {rc=0} 05:44:04.281026 --- ParallelTerminationStrategy: PID 30210 died... 05:44:04.299551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30210): Terminated: ok {rc=0} 05:44:04.343833 --- ParallelTerminationStrategy: PID 30213 died... 05:44:04.362458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30213): Terminated: ok {rc=0} 05:44:04.447915 bus /gobi_0: Setting Powered False 05:44:05.545171 bus /gobi_0: Setting Powered False 05:44:06.663253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:44:07.807548 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:07.818860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:07.877438 tst iperf3.py: using LAC 19332 05:44:08.007010 tst iperf3.py: using RAC 207 05:44:08.124299 tst iperf3.py: using CellId 19332 05:44:08.239737 tst iperf3.py: using BVCI 19333 05:44:08.347769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.358696 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.369469 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.380257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.391093 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.401840 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.412682 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.423353 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:08.434181 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:08.547962 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:08.746750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:09.044421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Launched 05:44:09.302281 run iperf3-srv_10.42.42.10(pid=30217): Launched 05:44:09.413759 tst iperf3.py:8: start network... 05:44:09.611953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:10.069493 run create_hlr_db(pid=30218): Launched 05:44:10.181982 bus /gobi_6: Setting Powered False 05:44:11.241357 run create_hlr_db(pid=30218): Terminated: ok {rc=0} 05:44:11.676647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30220): Launched 05:44:11.993491 run osmo-hlr_10.42.42.2(pid=30221): Launched 05:44:12.114522 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:12.662229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30223): Launched 05:44:12.977312 run osmo-stp_10.42.42.5(pid=30224): Launched 05:44:13.092175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:13.603377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30226): Launched 05:44:13.718397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:13.968410 run patchelf(pid=30227): Launched 05:44:14.133305 run osmo-stp_10.42.42.5(pid=30224): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30224)] 05:44:14.259166 run osmo-stp_10.42.42.5(pid=30224): stdout: | (launched: 2022-12-09_05:44:12.919999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:14.386297 run osmo-stp_10.42.42.5(pid=30224): stderr: | 20221209054413089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054413089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054413089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054413090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054413092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054413092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054413092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:14.513907 run osmo-stp_10.42.42.5(pid=30224): stdout: | (launched: 2022-12-09_05:44:12.919999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:14.636604 run osmo-stp_10.42.42.5(pid=30224): stderr: | 20221209054413089 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054413089 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054413089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054413090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054413092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054413092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054413092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:14.781597 run patchelf(pid=30227): Terminating (SIGINT) 05:44:14.948515 run patchelf(pid=30227): Terminated: ok {rc=0} 05:44:15.069210 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30224): Process ended prematurely: osmo-stp_10.42.42.5(pid=30224) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30224)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 05:44:15.078453 tst iperf3.py:8: Test FAILED (7.3 sec) 05:44:15.105722 run osmo-hlr_10.42.42.2(pid=30221): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30221)] 05:44:15.153696 run osmo-hlr_10.42.42.2(pid=30221): stdout: | (launched: 2022-12-09_05:44:11.936157) 05:44:15.203593 run osmo-hlr_10.42.42.2(pid=30221): stderr: | 20221209054412132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054412132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054412132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054412132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054412132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054412132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054412145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054412153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054412154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054412154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:15.253860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminating (SIGTERM) 05:44:15.294109 run iperf3-srv_10.42.42.10(pid=30217): Terminating (SIGTERM) 05:44:15.334441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30220): Terminating (SIGTERM) 05:44:15.375178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30223): Terminating (SIGTERM) 05:44:15.415771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30226): Terminating (SIGTERM) 05:44:15.456201 --- ParallelTerminationStrategy: PID 30216 died... 05:44:15.475345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30216): Terminated: ok {rc=0} 05:44:15.520219 --- ParallelTerminationStrategy: PID 30217 died... 05:44:15.539019 run iperf3-srv_10.42.42.10(pid=30217): Terminated {rc=256} 05:44:15.583355 --- ParallelTerminationStrategy: PID 30220 died... 05:44:15.601994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30220): Terminated: ok {rc=0} 05:44:15.646305 --- ParallelTerminationStrategy: PID 30223 died... 05:44:15.665008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30223): Terminated: ok {rc=0} 05:44:15.709482 --- ParallelTerminationStrategy: PID 30226 died... 05:44:15.727834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30226): Terminated: ok {rc=0} 05:44:15.814761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:44:16.996910 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.012505 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:17.083713 tst iperf3m4.py: using LAC 19333 05:44:17.203000 tst iperf3m4.py: using RAC 208 05:44:17.322164 tst iperf3m4.py: using CellId 19333 05:44:17.439465 tst iperf3m4.py: using BVCI 19334 05:44:17.547855 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.558622 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.569173 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.580398 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.591512 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.602587 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.614206 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.625309 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:17.636483 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:17.757482 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:17.880164 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:17.995809 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:18.114330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:44:18.329108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:18.648741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Launched 05:44:18.925248 run iperf3-srv_10.42.42.10(pid=30229): Launched 05:44:19.045498 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:44:19.259445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:19.581069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Launched 05:44:19.857743 run iperf3-srv_10.42.42.10(pid=30231): Launched 05:44:19.977512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:44:20.192074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:20.512387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Launched 05:44:20.789632 run iperf3-srv_10.42.42.10(pid=30233): Launched 05:44:20.909548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:44:21.124587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:21.444334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30234): Launched 05:44:21.722235 run iperf3-srv_10.42.42.10(pid=30235): Launched 05:44:21.841791 tst iperf3m4.py:8: start network... 05:44:22.056393 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:22.553934 run create_hlr_db(pid=30236): Launched 05:44:22.683852 bus /gobi_6: Setting Powered False 05:44:23.746573 run create_hlr_db(pid=30236): Terminated: ok {rc=0} 05:44:24.189660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Launched 05:44:24.507585 run osmo-hlr_10.42.42.2(pid=30239): Launched 05:44:24.628408 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:25.178499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Launched 05:44:25.496781 run osmo-stp_10.42.42.5(pid=30242): Launched 05:44:25.618479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:26.166487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30244): Launched 05:44:26.287675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:26.556539 run patchelf(pid=30245): Launched 05:44:26.733680 run osmo-stp_10.42.42.5(pid=30242): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] 05:44:26.869732 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-09_05:44:25.438630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:27.006648 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221209054425632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054425632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054425632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054425633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054425633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054425633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054425633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:27.144083 run osmo-stp_10.42.42.5(pid=30242): stdout: | (launched: 2022-12-09_05:44:25.438630) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:27.275988 run osmo-stp_10.42.42.5(pid=30242): stderr: | 20221209054425632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054425632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054425632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054425633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054425633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054425633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054425633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:27.431840 run patchelf(pid=30245): Terminating (SIGINT) 05:44:27.612108 run patchelf(pid=30245): Terminated: ok {rc=0} 05:44:27.741270 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:44:27.751059 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:44:27.779582 run osmo-hlr_10.42.42.2(pid=30239): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30239)] 05:44:27.829832 run osmo-hlr_10.42.42.2(pid=30239): stdout: | (launched: 2022-12-09_05:44:24.449660) 05:44:27.881712 run osmo-hlr_10.42.42.2(pid=30239): stderr: | 20221209054424650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054424650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054424650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054424650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054424650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054424650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054424663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054424673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054424674 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054424674 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:27.933687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Terminating (SIGTERM) 05:44:27.975587 run iperf3-srv_10.42.42.10(pid=30229): Terminating (SIGTERM) 05:44:28.017680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Terminating (SIGTERM) 05:44:28.059729 run iperf3-srv_10.42.42.10(pid=30231): Terminating (SIGTERM) 05:44:28.101675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Terminating (SIGTERM) 05:44:28.143930 run iperf3-srv_10.42.42.10(pid=30233): Terminating (SIGTERM) 05:44:28.185853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30234): Terminating (SIGTERM) 05:44:28.227721 run iperf3-srv_10.42.42.10(pid=30235): Terminating (SIGTERM) 05:44:28.269501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminating (SIGTERM) 05:44:28.311416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminating (SIGTERM) 05:44:28.353431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30244): Terminating (SIGTERM) 05:44:28.395566 --- ParallelTerminationStrategy: PID 30228 died... 05:44:28.415485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30228): Terminated: ok {rc=0} 05:44:28.461721 --- ParallelTerminationStrategy: PID 30229 died... 05:44:28.481560 run iperf3-srv_10.42.42.10(pid=30229): Terminated {rc=256} 05:44:28.527963 --- ParallelTerminationStrategy: PID 30230 died... 05:44:28.547678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Terminated: ok {rc=0} 05:44:28.593966 --- ParallelTerminationStrategy: PID 30231 died... 05:44:28.613538 run iperf3-srv_10.42.42.10(pid=30231): Terminated {rc=256} 05:44:28.659977 --- ParallelTerminationStrategy: PID 30232 died... 05:44:28.679602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Terminated: ok {rc=0} 05:44:28.725772 --- ParallelTerminationStrategy: PID 30233 died... 05:44:28.745330 run iperf3-srv_10.42.42.10(pid=30233): Terminated {rc=256} 05:44:28.791215 --- ParallelTerminationStrategy: PID 30234 died... 05:44:28.810789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30234): Terminated: ok {rc=0} 05:44:28.856778 --- ParallelTerminationStrategy: PID 30235 died... 05:44:28.876400 run iperf3-srv_10.42.42.10(pid=30235): Terminated {rc=256} 05:44:28.922062 --- ParallelTerminationStrategy: PID 30238 died... 05:44:28.941651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30238): Terminated: ok {rc=0} 05:44:28.987843 --- ParallelTerminationStrategy: PID 30241 died... 05:44:29.007544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30241): Terminated: ok {rc=0} 05:44:29.053396 --- ParallelTerminationStrategy: PID 30244 died... 05:44:29.072849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30244): Terminated: ok {rc=0} 05:44:29.160219 bus /gobi_4: Setting Powered False 05:44:30.260488 bus /gobi_4: Setting Powered False 05:44:31.387851 bus /gobi_1: Setting Powered False 05:44:32.497978 bus /gobi_1: Setting Powered False 05:44:33.613234 bus /gobi_0: Setting Powered False 05:44:34.711114 bus /gobi_0: Setting Powered False 05:44:35.828542 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:44:36.932326 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:36.944488 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:37.003080 tst ping.py: using LAC 19334 05:44:37.126507 tst ping.py: using RAC 209 05:44:37.252704 tst ping.py: using CellId 19334 05:44:37.375032 tst ping.py: using BVCI 19335 05:44:37.488744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.500061 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.511084 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.522257 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.533311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.544191 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.555375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:37.566420 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:37.685633 tst ping.py:19: start network... 05:44:37.896362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:38.381367 run create_hlr_db(pid=30246): Launched 05:44:38.508322 bus /gobi_6: Setting Powered False 05:44:39.570452 run create_hlr_db(pid=30246): Terminated: ok {rc=0} 05:44:39.990677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Launched 05:44:40.282065 run osmo-hlr_10.42.42.2(pid=30249): Launched 05:44:40.392143 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:40.913209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Launched 05:44:41.204346 run osmo-stp_10.42.42.5(pid=30252): Launched 05:44:41.317097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:41.820493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Launched 05:44:41.932759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:42.180799 run patchelf(pid=30255): Launched 05:44:42.344253 run osmo-stp_10.42.42.5(pid=30252): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] 05:44:42.469677 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-09_05:44:41.151134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:42.596355 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221209054441318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054441318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054441319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054441319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054441320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054441320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054441320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:42.723175 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-09_05:44:41.151134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:42.844206 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221209054441318 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054441318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054441319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054441319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054441320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054441320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054441320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:42.987259 run patchelf(pid=30255): Terminating (SIGINT) 05:44:43.153800 run patchelf(pid=30255): Terminated: ok {rc=0} 05:44:43.273322 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 05:44:43.282011 tst ping.py:22: Test FAILED (6.3 sec) 05:44:43.309239 run osmo-hlr_10.42.42.2(pid=30249): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30249)] 05:44:43.357365 run osmo-hlr_10.42.42.2(pid=30249): stdout: | (launched: 2022-12-09_05:44:40.229193) 05:44:43.407532 run osmo-hlr_10.42.42.2(pid=30249): stderr: | 20221209054440405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054440405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054440405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054440405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054440405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054440406 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054440417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054440425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054440426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054440426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:43.458040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminating (SIGTERM) 05:44:43.498677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminating (SIGTERM) 05:44:43.539361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminating (SIGTERM) 05:44:43.580069 --- ParallelTerminationStrategy: PID 30248 died... 05:44:43.599372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminated: ok {rc=0} 05:44:43.644268 --- ParallelTerminationStrategy: PID 30251 died... 05:44:43.663025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminated: ok {rc=0} 05:44:43.707450 --- ParallelTerminationStrategy: PID 30254 died... 05:44:43.726006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminated: ok {rc=0} 05:44:43.811330 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:44:44.900067 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:44.911820 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:44:44.973761 tst ping_idle_ping.py: using LAC 19335 05:44:45.089031 tst ping_idle_ping.py: using RAC 210 05:44:45.202089 tst ping_idle_ping.py: using CellId 19335 05:44:45.316801 tst ping_idle_ping.py: using BVCI 19336 05:44:45.422759 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.433629 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.444116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.454912 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.465632 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.476389 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.487439 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:44:45.498274 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:44:45.610872 tst ping_idle_ping.py:24: start network... 05:44:45.807570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:46.349937 run create_hlr_db(pid=30256): Launched 05:44:46.512473 bus /gobi_6: Setting Powered False 05:44:47.575941 run create_hlr_db(pid=30256): Terminated: ok {rc=0} 05:44:48.000117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Launched 05:44:48.292826 run osmo-hlr_10.42.42.2(pid=30259): Launched 05:44:48.403907 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:48.907673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Launched 05:44:49.200709 run osmo-stp_10.42.42.5(pid=30262): Launched 05:44:49.311659 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:44:49.815245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Launched 05:44:49.927384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:44:50.174501 run patchelf(pid=30265): Launched 05:44:50.338645 run osmo-stp_10.42.42.5(pid=30262): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] 05:44:50.463958 run osmo-stp_10.42.42.5(pid=30262): stdout: | (launched: 2022-12-09_05:44:49.147112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:50.591141 run osmo-stp_10.42.42.5(pid=30262): stderr: | 20221209054449317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054449317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054449317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054449318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054449318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054449318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054449318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:50.718019 run osmo-stp_10.42.42.5(pid=30262): stdout: | (launched: 2022-12-09_05:44:49.147112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:44:50.838614 run osmo-stp_10.42.42.5(pid=30262): stderr: | 20221209054449317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054449317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054449317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054449318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054449318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054449318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054449318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:44:50.981575 run patchelf(pid=30265): Terminating (SIGINT) 05:44:51.146954 run patchelf(pid=30265): Terminated: ok {rc=0} 05:44:51.267345 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30262): Process ended prematurely: osmo-stp_10.42.42.5(pid=30262) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:44:51.276466 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 05:44:51.303520 run osmo-hlr_10.42.42.2(pid=30259): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30259)] 05:44:51.352143 run osmo-hlr_10.42.42.2(pid=30259): stdout: | (launched: 2022-12-09_05:44:48.239206) 05:44:51.402439 run osmo-hlr_10.42.42.2(pid=30259): stderr: | 20221209054448412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054448412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054448412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054448412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054448412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054448412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054448424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054448433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054448433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054448433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:44:51.453039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Terminating (SIGTERM) 05:44:51.493539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Terminating (SIGTERM) 05:44:51.534094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Terminating (SIGTERM) 05:44:51.574649 --- ParallelTerminationStrategy: PID 30258 died... 05:44:51.593837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Terminated: ok {rc=0} 05:44:51.638672 --- ParallelTerminationStrategy: PID 30261 died... 05:44:51.657463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Terminated: ok {rc=0} 05:44:51.703398 --- ParallelTerminationStrategy: PID 30264 died... 05:44:51.722163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Terminated: ok {rc=0} 05:44:51.808589 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:44:53.101325 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:44:53.107397 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:44:53.128306 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:44:53.166245 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:44:53.249587 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:44:53.269628 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:44:53.307990 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:44:53.901703 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:44:53.949788 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:53.960482 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:44:54.015048 tst cs_paging_gprs_active.py: using LAC 19336 05:44:54.132653 tst cs_paging_gprs_active.py: using RAC 211 05:44:54.257470 tst cs_paging_gprs_active.py: using CellId 19336 05:44:54.383114 tst cs_paging_gprs_active.py: using BVCI 19337 05:44:54.499315 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.510762 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.521954 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.533339 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.544280 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.555409 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.566704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.577733 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:44:54.589138 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:54.708322 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:44:54.826157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:44:55.041490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:55.361118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30270): Launched 05:44:55.638918 run iperf3-srv_10.42.42.10(pid=30271): Launched 05:44:55.758591 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:44:55.973606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:44:56.292433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30272): Launched 05:44:56.568725 run iperf3-srv_10.42.42.10(pid=30273): Launched 05:44:56.689122 tst cs_paging_gprs_active.py:38: start network... 05:44:56.902909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:44:57.397720 run create_hlr_db(pid=30274): Launched 05:44:57.527711 bus /gobi_6: Setting Powered False 05:44:58.588371 run create_hlr_db(pid=30274): Terminated: ok {rc=0} 05:44:59.010187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30276): Launched 05:44:59.307396 run osmo-hlr_10.42.42.2(pid=30277): Launched 05:44:59.422525 run osmo-stp_10.42.42.5: Starting osmo-stp 05:44:59.938752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30279): Launched 05:45:00.235940 run osmo-stp_10.42.42.5(pid=30280): Launched 05:45:00.349401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:00.873651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30282): Launched 05:45:01.013940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:01.293716 run patchelf(pid=30283): Launched 05:45:01.476561 run osmo-stp_10.42.42.5(pid=30280): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30280)] 05:45:01.631702 run osmo-stp_10.42.42.5(pid=30280): stdout: | (launched: 2022-12-09_05:45:00.181703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:01.772361 run osmo-stp_10.42.42.5(pid=30280): stderr: | 20221209054500350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054500350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054500351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054500351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054500351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054500351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054500351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:01.908365 run osmo-stp_10.42.42.5(pid=30280): stdout: | (launched: 2022-12-09_05:45:00.181703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:02.035137 run osmo-stp_10.42.42.5(pid=30280): stderr: | 20221209054500350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054500350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054500351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054500351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054500351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054500351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054500351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:02.184218 run patchelf(pid=30283): Terminating (SIGINT) 05:45:02.357743 run patchelf(pid=30283): Terminated: ok {rc=0} 05:45:02.483809 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30280): Process ended prematurely: osmo-stp_10.42.42.5(pid=30280) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30280)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:45:02.494491 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:45:02.525143 run osmo-hlr_10.42.42.2(pid=30277): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30277)] 05:45:02.575435 run osmo-hlr_10.42.42.2(pid=30277): stdout: | (launched: 2022-12-09_05:44:59.253488) 05:45:02.627745 run osmo-hlr_10.42.42.2(pid=30277): stderr: | 20221209054459429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054459429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054459429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054459429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054459429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054459429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054459441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054459450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054459450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054459450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:02.693284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30270): Terminating (SIGTERM) 05:45:02.736462 run iperf3-srv_10.42.42.10(pid=30271): Terminating (SIGTERM) 05:45:02.780775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30272): Terminating (SIGTERM) 05:45:02.822339 run iperf3-srv_10.42.42.10(pid=30273): Terminating (SIGTERM) 05:45:02.863023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30276): Terminating (SIGTERM) 05:45:02.903685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30279): Terminating (SIGTERM) 05:45:02.944353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30282): Terminating (SIGTERM) 05:45:02.985088 --- ParallelTerminationStrategy: PID 30270 died... 05:45:03.004010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30270): Terminated: ok {rc=0} 05:45:03.049416 --- ParallelTerminationStrategy: PID 30271 died... 05:45:03.067884 run iperf3-srv_10.42.42.10(pid=30271): Terminated {rc=256} 05:45:03.113179 --- ParallelTerminationStrategy: PID 30272 died... 05:45:03.131590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30272): Terminated: ok {rc=0} 05:45:03.176556 --- ParallelTerminationStrategy: PID 30273 died... 05:45:03.195063 run iperf3-srv_10.42.42.10(pid=30273): Terminated {rc=256} 05:45:03.240093 --- ParallelTerminationStrategy: PID 30276 died... 05:45:03.258484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30276): Terminated: ok {rc=0} 05:45:03.304035 --- ParallelTerminationStrategy: PID 30279 died... 05:45:03.322516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30279): Terminated: ok {rc=0} 05:45:03.367159 --- ParallelTerminationStrategy: PID 30282 died... 05:45:03.385982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30282): Terminated: ok {rc=0} 05:45:03.471682 bus /gobi_0: Setting Powered False 05:45:04.570458 bus /gobi_0: Setting Powered False 05:45:05.685317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:45:06.831438 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:06.842755 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:06.901731 tst iperf3.py: using LAC 19337 05:45:07.027216 tst iperf3.py: using RAC 212 05:45:07.154994 tst iperf3.py: using CellId 19337 05:45:07.279007 tst iperf3.py: using BVCI 19338 05:45:07.388829 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.399822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.410774 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.421433 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.432466 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.443400 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.454423 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.465068 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:07.475804 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:07.594185 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:45:07.809819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:08.128148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30294): Launched 05:45:08.404074 run iperf3-srv_10.42.42.10(pid=30295): Launched 05:45:08.523538 tst iperf3.py:8: start network... 05:45:08.737599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:09.230283 run create_hlr_db(pid=30296): Launched 05:45:09.359753 bus /gobi_6: Setting Powered False 05:45:10.422873 run create_hlr_db(pid=30296): Terminated: ok {rc=0} 05:45:10.866562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30298): Launched 05:45:11.184021 run osmo-hlr_10.42.42.2(pid=30299): Launched 05:45:11.304653 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:11.854393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30301): Launched 05:45:12.174219 run osmo-stp_10.42.42.5(pid=30302): Launched 05:45:12.294797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:12.853659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30304): Launched 05:45:12.983537 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:13.265767 run patchelf(pid=30329): Launched 05:45:13.451683 run osmo-stp_10.42.42.5(pid=30302): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30302)] 05:45:13.590078 run osmo-stp_10.42.42.5(pid=30302): stdout: | (launched: 2022-12-09_05:45:12.116489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:13.729497 run osmo-stp_10.42.42.5(pid=30302): stderr: | 20221209054512307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054512308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054512308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054512308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054512309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054512309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054512309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:13.870334 run osmo-stp_10.42.42.5(pid=30302): stdout: | (launched: 2022-12-09_05:45:12.116489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:14.005507 run osmo-stp_10.42.42.5(pid=30302): stderr: | 20221209054512307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054512308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054512308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054512308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054512309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054512309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054512309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:14.164609 run patchelf(pid=30329): Terminating (SIGINT) 05:45:14.346997 run patchelf(pid=30329): Terminated: ok {rc=0} 05:45:14.479215 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30302): Process ended prematurely: osmo-stp_10.42.42.5(pid=30302) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30302)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 05:45:14.490226 tst iperf3.py:8: Test FAILED (7.7 sec) 05:45:14.519342 run osmo-hlr_10.42.42.2(pid=30299): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30299)] 05:45:14.570516 run osmo-hlr_10.42.42.2(pid=30299): stdout: | (launched: 2022-12-09_05:45:11.126556) 05:45:14.623393 run osmo-hlr_10.42.42.2(pid=30299): stderr: | 20221209054511323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054511323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054511323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054511323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054511323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054511323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054511335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054511344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054511344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054511344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:14.676764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30294): Terminating (SIGTERM) 05:45:14.719575 run iperf3-srv_10.42.42.10(pid=30295): Terminating (SIGTERM) 05:45:14.763830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30298): Terminating (SIGTERM) 05:45:14.807049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30301): Terminating (SIGTERM) 05:45:14.850249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30304): Terminating (SIGTERM) 05:45:14.896096 --- ParallelTerminationStrategy: PID 30294 died... 05:45:14.916712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30294): Terminated: ok {rc=0} 05:45:14.965860 --- ParallelTerminationStrategy: PID 30295 died... 05:45:14.986037 run iperf3-srv_10.42.42.10(pid=30295): Terminated {rc=256} 05:45:15.032890 --- ParallelTerminationStrategy: PID 30298 died... 05:45:15.052775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30298): Terminated: ok {rc=0} 05:45:15.098968 --- ParallelTerminationStrategy: PID 30301 died... 05:45:15.118410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30301): Terminated: ok {rc=0} 05:45:15.164211 --- ParallelTerminationStrategy: PID 30304 died... 05:45:15.183810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30304): Terminated: ok {rc=0} 05:45:15.272664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:45:16.424554 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:16.436870 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:16.493807 tst iperf3m4.py: using LAC 19338 05:45:16.620169 tst iperf3m4.py: using RAC 213 05:45:16.749576 tst iperf3m4.py: using CellId 19338 05:45:16.883522 tst iperf3m4.py: using BVCI 19339 05:45:16.997192 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.008717 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.019943 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.031918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.043737 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.055689 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.068096 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.079964 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:17.091704 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:17.209768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:17.327281 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:17.446986 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:17.566072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:45:17.765689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:18.063446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Launched 05:45:18.322489 run iperf3-srv_10.42.42.10(pid=30658): Launched 05:45:18.434058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:45:18.632588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:18.930330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30659): Launched 05:45:19.188938 run iperf3-srv_10.42.42.10(pid=30660): Launched 05:45:19.300416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:45:19.499760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:19.798066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30661): Launched 05:45:20.055990 run iperf3-srv_10.42.42.10(pid=30662): Launched 05:45:20.167290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:45:20.366102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:45:20.665362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Launched 05:45:20.925486 run iperf3-srv_10.42.42.10(pid=30664): Launched 05:45:21.037233 tst iperf3m4.py:8: start network... 05:45:21.236597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:21.697706 run create_hlr_db(pid=30665): Launched 05:45:21.811728 bus /gobi_6: Setting Powered False 05:45:22.871254 run create_hlr_db(pid=30665): Terminated: ok {rc=0} 05:45:23.314423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30671): Launched 05:45:23.661678 run osmo-hlr_10.42.42.2(pid=30698): Launched 05:45:23.896510 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:24.513837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Launched 05:45:24.837790 run osmo-stp_10.42.42.5(pid=30846): Launched 05:45:25.067832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:25.745762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30848): Launched 05:45:25.872122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:26.140285 run patchelf(pid=30849): Launched 05:45:26.329242 run osmo-stp_10.42.42.5(pid=30846): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] 05:45:26.462704 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-09_05:45:24.764740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:26.597724 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221209054525090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054525090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054525091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054525091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054525091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054525091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054525092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:26.732313 run osmo-stp_10.42.42.5(pid=30846): stdout: | (launched: 2022-12-09_05:45:24.764740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:26.863140 run osmo-stp_10.42.42.5(pid=30846): stderr: | 20221209054525090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054525090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054525091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054525091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054525091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054525091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054525092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:27.016594 run patchelf(pid=30849): Terminating (SIGINT) 05:45:27.193429 run patchelf(pid=30849): Terminated: ok {rc=0} 05:45:27.321079 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30846): Process ended prematurely: osmo-stp_10.42.42.5(pid=30846) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:45:27.331683 tst iperf3m4.py:8: Test FAILED (10.9 sec) 05:45:27.364651 run osmo-hlr_10.42.42.2(pid=30698): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30698)] 05:45:27.416072 run osmo-hlr_10.42.42.2(pid=30698): stdout: | (launched: 2022-12-09_05:45:23.592294) 05:45:27.469129 run osmo-hlr_10.42.42.2(pid=30698): stderr: | 20221209054523938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054523938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054523938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054523938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054523938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054523939 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054523963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054523982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054523982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054523982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:27.523658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Terminating (SIGTERM) 05:45:27.567827 run iperf3-srv_10.42.42.10(pid=30658): Terminating (SIGTERM) 05:45:27.614163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30659): Terminating (SIGTERM) 05:45:27.658082 run iperf3-srv_10.42.42.10(pid=30660): Terminating (SIGTERM) 05:45:27.704415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30661): Terminating (SIGTERM) 05:45:27.747963 run iperf3-srv_10.42.42.10(pid=30662): Terminating (SIGTERM) 05:45:27.791162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Terminating (SIGTERM) 05:45:27.834910 run iperf3-srv_10.42.42.10(pid=30664): Terminating (SIGTERM) 05:45:27.877908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30671): Terminating (SIGTERM) 05:45:27.921343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminating (SIGTERM) 05:45:27.964915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30848): Terminating (SIGTERM) 05:45:28.010416 --- ParallelTerminationStrategy: PID 30657 died... 05:45:28.030324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Terminated: ok {rc=0} 05:45:28.080802 --- ParallelTerminationStrategy: PID 30658 died... 05:45:28.100762 run iperf3-srv_10.42.42.10(pid=30658): Terminated {rc=256} 05:45:28.148813 --- ParallelTerminationStrategy: PID 30659 died... 05:45:28.168825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30659): Terminated: ok {rc=0} 05:45:28.217409 --- ParallelTerminationStrategy: PID 30660 died... 05:45:28.237267 run iperf3-srv_10.42.42.10(pid=30660): Terminated {rc=256} 05:45:28.285320 --- ParallelTerminationStrategy: PID 30661 died... 05:45:28.305509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30661): Terminated: ok {rc=0} 05:45:28.354834 --- ParallelTerminationStrategy: PID 30662 died... 05:45:28.374912 run iperf3-srv_10.42.42.10(pid=30662): Terminated {rc=256} 05:45:28.423745 --- ParallelTerminationStrategy: PID 30663 died... 05:45:28.443712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Terminated: ok {rc=0} 05:45:28.491977 --- ParallelTerminationStrategy: PID 30664 died... 05:45:28.512029 run iperf3-srv_10.42.42.10(pid=30664): Terminated {rc=256} 05:45:28.560769 --- ParallelTerminationStrategy: PID 30671 died... 05:45:28.581663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30671): Terminated: ok {rc=0} 05:45:28.630982 --- ParallelTerminationStrategy: PID 30845 died... 05:45:28.651336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30845): Terminated: ok {rc=0} 05:45:28.700309 --- ParallelTerminationStrategy: PID 30848 died... 05:45:28.720543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30848): Terminated: ok {rc=0} 05:45:28.811413 bus /gobi_4: Setting Powered False 05:45:29.913548 bus /gobi_4: Setting Powered False 05:45:31.047149 bus /gobi_1: Setting Powered False 05:45:32.160615 bus /gobi_1: Setting Powered False 05:45:33.281229 bus /gobi_0: Setting Powered False 05:45:34.381146 bus /gobi_0: Setting Powered False 05:45:35.498623 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:45:36.603340 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:36.614962 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:36.672395 tst ping.py: using LAC 19339 05:45:36.792036 tst ping.py: using RAC 214 05:45:36.909848 tst ping.py: using CellId 19339 05:45:37.030325 tst ping.py: using BVCI 19340 05:45:37.141936 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.152779 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.163555 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.174523 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.185585 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.196313 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.207666 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:37.218674 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:37.336735 tst ping.py:19: start network... 05:45:37.556598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:38.058441 run create_hlr_db(pid=30852): Launched 05:45:38.189517 bus /gobi_6: Setting Powered False 05:45:39.253934 run create_hlr_db(pid=30852): Terminated: ok {rc=0} 05:45:39.706399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Launched 05:45:40.029727 run osmo-hlr_10.42.42.2(pid=30855): Launched 05:45:40.151906 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:40.715058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Launched 05:45:41.038807 run osmo-stp_10.42.42.5(pid=30858): Launched 05:45:41.160738 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:41.718491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Launched 05:45:41.841988 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:42.114823 run patchelf(pid=30861): Launched 05:45:42.294848 run osmo-stp_10.42.42.5(pid=30858): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] 05:45:42.432299 run osmo-stp_10.42.42.5(pid=30858): stdout: | (launched: 2022-12-09_05:45:40.979515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:42.571688 run osmo-stp_10.42.42.5(pid=30858): stderr: | 20221209054541170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054541170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054541170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054541170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054541173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054541173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054541173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:42.711122 run osmo-stp_10.42.42.5(pid=30858): stdout: | (launched: 2022-12-09_05:45:40.979515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:42.843504 run osmo-stp_10.42.42.5(pid=30858): stderr: | 20221209054541170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054541170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054541170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054541170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054541173 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054541173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054541173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:43.000092 run patchelf(pid=30861): Terminating (SIGINT) 05:45:43.180819 run patchelf(pid=30861): Terminated: ok {rc=0} 05:45:43.311395 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30858): Process ended prematurely: osmo-stp_10.42.42.5(pid=30858) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 05:45:43.320889 tst ping.py:22: Test FAILED (6.7 sec) 05:45:43.349268 run osmo-hlr_10.42.42.2(pid=30855): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30855)] 05:45:43.400191 run osmo-hlr_10.42.42.2(pid=30855): stdout: | (launched: 2022-12-09_05:45:39.970212) 05:45:43.452807 run osmo-hlr_10.42.42.2(pid=30855): stderr: | 20221209054540168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054540168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054540168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054540168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054540168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054540168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054540180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054540188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054540189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054540189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:43.506142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Terminating (SIGTERM) 05:45:43.548794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Terminating (SIGTERM) 05:45:43.591472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Terminating (SIGTERM) 05:45:43.634447 --- ParallelTerminationStrategy: PID 30854 died... 05:45:43.654850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30854): Terminated: ok {rc=0} 05:45:43.702470 --- ParallelTerminationStrategy: PID 30857 died... 05:45:43.722629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30857): Terminated: ok {rc=0} 05:45:43.769503 --- ParallelTerminationStrategy: PID 30860 died... 05:45:43.789508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30860): Terminated: ok {rc=0} 05:45:43.878872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:45:44.966875 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:44.979497 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:45:45.040259 tst ping_idle_ping.py: using LAC 19340 05:45:45.167277 tst ping_idle_ping.py: using RAC 215 05:45:45.293982 tst ping_idle_ping.py: using CellId 19340 05:45:45.420472 tst ping_idle_ping.py: using BVCI 19341 05:45:45.537883 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.549405 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.560646 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.571942 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.583183 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.594391 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.605828 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:45:45.617019 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:45:45.732086 tst ping_idle_ping.py:24: start network... 05:45:45.942208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:46.431922 run create_hlr_db(pid=30862): Launched 05:45:46.587257 bus /gobi_6: Setting Powered False 05:45:47.647267 run create_hlr_db(pid=30862): Terminated: ok {rc=0} 05:45:48.091862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Launched 05:45:48.414572 run osmo-hlr_10.42.42.2(pid=30865): Launched 05:45:48.538361 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:49.094072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Launched 05:45:49.417638 run osmo-stp_10.42.42.5(pid=30868): Launched 05:45:49.540787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:50.098360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Launched 05:45:50.222108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:50.494596 run patchelf(pid=30871): Launched 05:45:50.675042 run osmo-stp_10.42.42.5(pid=30868): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] 05:45:50.812238 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-09_05:45:49.358412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:50.951324 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221209054549550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054549551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054549551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054549551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054549552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054549552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054549552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:51.090246 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-09_05:45:49.358412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:45:51.222376 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221209054549550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054549551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054549551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054549551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054549552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054549552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054549552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:45:51.379410 run patchelf(pid=30871): Terminating (SIGINT) 05:45:51.560585 run patchelf(pid=30871): Terminated: ok {rc=0} 05:45:51.691582 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:45:51.701074 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 05:45:51.728918 run osmo-hlr_10.42.42.2(pid=30865): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30865)] 05:45:51.779644 run osmo-hlr_10.42.42.2(pid=30865): stdout: | (launched: 2022-12-09_05:45:48.355572) 05:45:51.831825 run osmo-hlr_10.42.42.2(pid=30865): stderr: | 20221209054548554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054548554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054548554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054548555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054548555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054548555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054548567 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054548575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054548575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054548575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:45:51.884457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminating (SIGTERM) 05:45:51.926668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminating (SIGTERM) 05:45:51.968745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Terminating (SIGTERM) 05:45:52.011491 --- ParallelTerminationStrategy: PID 30864 died... 05:45:52.031585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminated: ok {rc=0} 05:45:52.078029 --- ParallelTerminationStrategy: PID 30867 died... 05:45:52.097627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminated: ok {rc=0} 05:45:52.143840 --- ParallelTerminationStrategy: PID 30870 died... 05:45:52.163388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30870): Terminated: ok {rc=0} 05:45:52.251748 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:45:53.545429 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:45:53.552665 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:45:53.574130 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:45:53.611972 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:45:53.665188 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:45:53.685520 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:45:53.719867 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:45:54.276238 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:45:54.283405 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.295540 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:45:54.354950 tst switch_tch_pdch.py: using LAC 19341 05:45:54.485630 tst switch_tch_pdch.py: using RAC 216 05:45:54.611715 tst switch_tch_pdch.py: using CellId 19341 05:45:54.736032 tst switch_tch_pdch.py: using BVCI 19342 05:45:54.852289 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.864049 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.875502 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.887038 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.898349 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.909899 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.921677 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:45:54.933059 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:45:55.049941 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:45:55.170785 tst switch_tch_pdch.py:51: start network... 05:45:55.387499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:45:55.886518 run create_hlr_db(pid=30877): Launched 05:45:56.016818 bus /gobi_6: Setting Powered False 05:45:57.080242 run create_hlr_db(pid=30877): Terminated: ok {rc=0} 05:45:57.512281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30879): Launched 05:45:57.814309 run osmo-hlr_10.42.42.2(pid=30880): Launched 05:45:57.928208 run osmo-stp_10.42.42.5: Starting osmo-stp 05:45:58.464939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30882): Launched 05:45:58.767099 run osmo-stp_10.42.42.5(pid=30883): Launched 05:45:58.881464 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:45:59.400788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30885): Launched 05:45:59.516454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:45:59.771339 run patchelf(pid=30886): Launched 05:45:59.940072 run osmo-stp_10.42.42.5(pid=30883): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30883)] 05:46:00.067997 run osmo-stp_10.42.42.5(pid=30883): stdout: | (launched: 2022-12-09_05:45:58.710843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:00.197721 run osmo-stp_10.42.42.5(pid=30883): stderr: | 20221209054558883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054558884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054558884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054558884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054558885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054558885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054558885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:00.327571 run osmo-stp_10.42.42.5(pid=30883): stdout: | (launched: 2022-12-09_05:45:58.710843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:00.451281 run osmo-stp_10.42.42.5(pid=30883): stderr: | 20221209054558883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054558884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054558884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054558884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054558885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054558885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054558885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:00.597999 run patchelf(pid=30886): Terminating (SIGINT) 05:46:00.767448 run patchelf(pid=30886): Terminated: ok {rc=0} 05:46:00.901844 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30883): Process ended prematurely: osmo-stp_10.42.42.5(pid=30883) [trial-2355↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30883)] [trial-2355↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:46:00.916274 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 05:46:00.946937 run osmo-hlr_10.42.42.2(pid=30880): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30880)] 05:46:01.000114 run osmo-hlr_10.42.42.2(pid=30880): stdout: | (launched: 2022-12-09_05:45:57.758494) 05:46:01.053847 run osmo-hlr_10.42.42.2(pid=30880): stderr: | 20221209054557932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054557932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054557932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054557932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054557932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054557932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054557945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054557954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054557954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054557954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:01.107886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30879): Terminating (SIGTERM) 05:46:01.151558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30882): Terminating (SIGTERM) 05:46:01.198280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30885): Terminating (SIGTERM) 05:46:01.243985 --- ParallelTerminationStrategy: PID 30879 died... 05:46:01.264931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30879): Terminated: ok {rc=0} 05:46:01.313739 --- ParallelTerminationStrategy: PID 30882 died... 05:46:01.334338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30882): Terminated: ok {rc=0} 05:46:01.382894 --- ParallelTerminationStrategy: PID 30885 died... 05:46:01.403410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30885): Terminated: ok {rc=0} 05:46:01.494338 bus /gobi_0: Setting Powered False 05:46:02.595424 bus /gobi_0: Setting Powered False 05:46:03.711824 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:46:04.970222 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:04.977572 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:46:04.999396 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:46:05.035015 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:46:05.091425 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:46:05.112900 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:46:05.148370 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:46:05.702331 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:46:05.707518 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:05.718826 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:46:05.776679 tst switch_tch_pdch.py: using LAC 19342 05:46:05.904056 tst switch_tch_pdch.py: using RAC 217 05:46:06.029554 tst switch_tch_pdch.py: using CellId 19342 05:46:06.150083 tst switch_tch_pdch.py: using BVCI 19343 05:46:06.261183 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.272239 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.283228 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.294557 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.305772 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.317274 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.328644 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:46:06.339623 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:46:06.459244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:46:06.576181 tst switch_tch_pdch.py:51: start network... 05:46:06.779004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:07.221651 run create_hlr_db(pid=30890): Launched 05:46:07.335819 bus /gobi_6: Setting Powered False 05:46:08.395401 run create_hlr_db(pid=30890): Terminated: ok {rc=0} 05:46:08.809643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Launched 05:46:09.132806 run osmo-hlr_10.42.42.2(pid=30893): Launched 05:46:09.255280 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:09.781557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Launched 05:46:10.105577 run osmo-stp_10.42.42.5(pid=30896): Launched 05:46:10.227155 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:46:10.756262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30898): Launched 05:46:10.879377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:46:11.151373 run patchelf(pid=30899): Launched 05:46:11.330474 run osmo-stp_10.42.42.5(pid=30896): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] 05:46:11.466973 run osmo-stp_10.42.42.5(pid=30896): stdout: | (launched: 2022-12-09_05:46:10.046449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:11.605549 run osmo-stp_10.42.42.5(pid=30896): stderr: | 20221209054610239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054610239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054610240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054610240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054610242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054610242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054610242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:11.743261 run osmo-stp_10.42.42.5(pid=30896): stdout: | (launched: 2022-12-09_05:46:10.046449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:11.874947 run osmo-stp_10.42.42.5(pid=30896): stderr: | 20221209054610239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054610239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054610240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054610240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054610242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054610242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054610242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:12.031968 run patchelf(pid=30899): Terminating (SIGINT) 05:46:12.212065 run patchelf(pid=30899): Terminated: ok {rc=0} 05:46:12.341884 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30896): Process ended prematurely: osmo-stp_10.42.42.5(pid=30896) [trial-2355↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] [trial-2355↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:46:12.351491 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 05:46:12.379460 run osmo-hlr_10.42.42.2(pid=30893): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30893)] 05:46:12.429846 run osmo-hlr_10.42.42.2(pid=30893): stdout: | (launched: 2022-12-09_05:46:09.073580) 05:46:12.482176 run osmo-hlr_10.42.42.2(pid=30893): stderr: | 20221209054609273 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054609273 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054609273 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054609273 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054609273 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054609273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054609286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054609294 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054609294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054609294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:12.534830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Terminating (SIGTERM) 05:46:12.577387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Terminating (SIGTERM) 05:46:12.619640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30898): Terminating (SIGTERM) 05:46:12.662081 --- ParallelTerminationStrategy: PID 30892 died... 05:46:12.682219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30892): Terminated: ok {rc=0} 05:46:12.728522 --- ParallelTerminationStrategy: PID 30895 died... 05:46:12.748037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30895): Terminated: ok {rc=0} 05:46:12.794178 --- ParallelTerminationStrategy: PID 30898 died... 05:46:12.813660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30898): Terminated: ok {rc=0} 05:46:12.902285 bus /gobi_0: Setting Powered False 05:46:13.999336 bus /gobi_0: Setting Powered False 05:46:15.116019 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:trx-b200 --------------------------------------------------------------------- 05:46:16.367386 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:16.372325 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:16.418189 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:46:16.428220 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:46:16.491879 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:16.533948 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:46:16.543845 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:46:17.074686 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:46:17.081897 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 05:46:17.094040 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 05:46:17.147774 tst mo_mt_sms.py: using LAC 19343 05:46:17.272054 tst mo_mt_sms.py: using RAC 218 05:46:17.392258 tst mo_mt_sms.py: using CellId 19343 05:46:17.510850 tst mo_mt_sms.py: using BVCI 19344 05:46:17.620522 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:17.738397 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:17.854338 tst mo_mt_sms.py:9: start nitb and bts... 05:46:18.057652 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:46:18.674995 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30903): Launched 05:46:18.977457 run osmo-nitb_10.42.42.2(pid=30904): Launched 05:46:19.145254 run osmo-nitb_10.42.42.2(pid=30904): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30904)] 05:46:19.281408 run osmo-nitb_10.42.42.2(pid=30904): stdout: | (launched: 2022-12-09_05:46:18.921731) 05:46:19.419882 run osmo-nitb_10.42.42.2(pid=30904): stderr: | (launched: 2022-12-09_05:46:18.966359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:19.557954 run osmo-nitb_10.42.42.2(pid=30904): stdout: | (launched: 2022-12-09_05:46:18.921731) 05:46:19.690155 run osmo-nitb_10.42.42.2(pid=30904): stderr: | (launched: 2022-12-09_05:46:18.966359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30904): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30904) [trial-2355↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30904)] 05:46:20.092017 tst osmo-nitb_10.42.42.2(pid=30904): stdout: | (launched: 2022-12-09_05:46:18.921731) 05:46:20.214425 tst osmo-nitb_10.42.42.2(pid=30904): stderr: | (launched: 2022-12-09_05:46:18.966359) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:20.358521 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30904): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30904) [trial-2355↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30904)] [trial-2355↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 05:46:20.367121 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 05:46:20.373906 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30903): Terminating (SIGTERM) 05:46:20.585819 --- ParallelTerminationStrategy: PID 30903 died... 05:46:20.607252 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30903): Terminated: ok {rc=0} 05:46:20.696327 bus /sierra_3: Setting Powered False 05:46:21.798945 bus /sierra_3: Setting Powered False 05:46:22.919036 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:trx-b200 --------------------------------------------------------------------- 05:46:24.121042 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:24.125482 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:24.159857 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:46:24.186783 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 05:46:24.239428 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:24.272448 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:46:24.299242 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 05:46:24.847955 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 05:46:24.853432 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:24.864530 tst sms:trx-b200: Using 1 x bts (candidates: 1) 05:46:24.913883 tst mo_mt_sms.py: using LAC 19344 05:46:25.033970 tst mo_mt_sms.py: using RAC 219 05:46:25.155558 tst mo_mt_sms.py: using CellId 19344 05:46:25.271986 tst mo_mt_sms.py: using BVCI 19345 05:46:25.381464 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:25.392268 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:25.403000 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:25.414135 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:25.425240 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:25.436003 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:25.556059 tst sms:trx-b200: Using 1 x modem (candidates: 2) 05:46:25.672539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:26.143079 run create_hlr_db(pid=30909): Launched 05:46:26.258200 bus /sierra_2: Setting Powered False 05:46:27.318647 run create_hlr_db(pid=30909): Terminated: ok {rc=0} 05:46:27.764235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Launched 05:46:28.089067 run osmo-hlr_10.42.42.2(pid=30912): Launched 05:46:28.211997 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:28.769016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Launched 05:46:29.091790 run osmo-stp_10.42.42.5(pid=30915): Launched 05:46:29.213783 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:29.797496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Launched 05:46:30.120228 run osmo-msc_10.42.42.6(pid=30918): Launched 05:46:30.298674 run osmo-stp_10.42.42.5(pid=30915): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] 05:46:30.435588 run osmo-stp_10.42.42.5(pid=30915): stdout: | (launched: 2022-12-09_05:46:29.032263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:30.572568 run osmo-stp_10.42.42.5(pid=30915): stderr: | 20221209054629225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054629225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054629225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054629226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054629226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054629226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054629226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:30.707625 run osmo-stp_10.42.42.5(pid=30915): stdout: | (launched: 2022-12-09_05:46:29.032263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:30.848301 run osmo-stp_10.42.42.5(pid=30915): stderr: | 20221209054629225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054629225 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054629225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054629226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054629226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054629226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054629226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:31.019936 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30915): Process ended prematurely: osmo-stp_10.42.42.5(pid=30915) [trial-2355↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] [trial-2355↪sms:trx-b200↪mo_mt_sms.py:16] 05:46:31.029330 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 05:46:31.059182 run osmo-hlr_10.42.42.2(pid=30912): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30912)] 05:46:31.111191 run osmo-hlr_10.42.42.2(pid=30912): stdout: | (launched: 2022-12-09_05:46:28.028821) 05:46:31.164876 run osmo-hlr_10.42.42.2(pid=30912): stderr: | 20221209054628229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054628229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054628229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054628229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054628229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054628229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054628245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054628255 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054628255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054628255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:31.239459 run osmo-msc_10.42.42.6(pid=30918): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30918)] 05:46:31.291182 run osmo-msc_10.42.42.6(pid=30918): stdout: | (launched: 2022-12-09_05:46:30.060424) 05:46:31.344433 run osmo-msc_10.42.42.6(pid=30918): stderr: | 20221209054630384 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054630384 DLGLOBAL DEBUG validating counter group 0x7f96d142fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054630384 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054630384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054630384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054630384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054630386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054630386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054630387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054630387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:31.399705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Terminating (SIGTERM) 05:46:31.443806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Terminating (SIGTERM) 05:46:31.489532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Terminating (SIGTERM) 05:46:31.535175 --- ParallelTerminationStrategy: PID 30911 died... 05:46:31.555501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30911): Terminated: ok {rc=0} 05:46:31.607422 --- ParallelTerminationStrategy: PID 30914 died... 05:46:31.627503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30914): Terminated: ok {rc=0} 05:46:31.676934 --- ParallelTerminationStrategy: PID 30917 died... 05:46:31.697218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30917): Terminated: ok {rc=0} 05:46:31.787137 bus /sierra_3: Setting Powered False 05:46:32.886280 bus /sierra_3: Setting Powered False 05:46:34.004482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-b200 --------------------------------------------------------------------- 05:46:35.236606 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:35.240392 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:35.275931 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 05:46:35.282969 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:46:35.318978 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:35.353705 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 05:46:35.360671 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:46:35.882746 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:46:35.887824 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 05:46:35.899043 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 05:46:35.949065 tst assert_extension.py: using LAC 19345 05:46:36.074236 tst assert_extension.py: using RAC 220 05:46:36.200557 tst assert_extension.py: using CellId 19345 05:46:36.325643 tst assert_extension.py: using BVCI 19346 05:46:36.442375 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 05:46:36.558931 tst assert_extension.py:10: start nitb and bts... 05:46:36.761840 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:46:37.378746 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30923): Launched 05:46:37.680215 run osmo-nitb_10.42.42.2(pid=30924): Launched 05:46:37.847188 run osmo-nitb_10.42.42.2(pid=30924): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30924)] 05:46:37.982801 run osmo-nitb_10.42.42.2(pid=30924): stdout: | (launched: 2022-12-09_05:46:37.624531) 05:46:38.120113 run osmo-nitb_10.42.42.2(pid=30924): stderr: | (launched: 2022-12-09_05:46:37.669317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:38.258265 run osmo-nitb_10.42.42.2(pid=30924): stdout: | (launched: 2022-12-09_05:46:37.624531) 05:46:38.389722 run osmo-nitb_10.42.42.2(pid=30924): stderr: | (launched: 2022-12-09_05:46:37.669317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30924) [trial-2355↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30924)] 05:46:38.793758 tst osmo-nitb_10.42.42.2(pid=30924): stdout: | (launched: 2022-12-09_05:46:37.624531) 05:46:38.915247 tst osmo-nitb_10.42.42.2(pid=30924): stderr: | (launched: 2022-12-09_05:46:37.669317) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:46:39.058602 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30924) [trial-2355↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30924)] [trial-2355↪nitb_ussd:trx-b200↪assert_extension.py:12] 05:46:39.066922 tst assert_extension.py:12: Test FAILED (3.2 sec) 05:46:39.073505 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30923): Terminating (SIGTERM) 05:46:39.283567 --- ParallelTerminationStrategy: PID 30923 died... 05:46:39.304421 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30923): Terminated: ok {rc=0} 05:46:39.392058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:trx-b200 --------------------------------------------------------------------- 05:46:40.574773 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:40.579513 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 05:46:40.614134 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:46:40.641934 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 05:46:40.677949 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 05:46:40.713299 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:46:40.741635 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 05:46:41.268883 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:trx-b200 assert_extension.py ---------------------------------------------- 05:46:41.274353 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.285624 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 05:46:41.335882 tst assert_extension.py: using LAC 19346 05:46:41.461869 tst assert_extension.py: using RAC 221 05:46:41.588659 tst assert_extension.py: using CellId 19346 05:46:41.713902 tst assert_extension.py: using BVCI 19347 05:46:41.830794 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.841936 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.852854 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.863812 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.874765 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 05:46:41.885994 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 05:46:42.003699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:42.505247 run create_hlr_db(pid=30928): Launched 05:46:42.636760 bus /sierra_2: Setting Powered False 05:46:43.700131 run create_hlr_db(pid=30928): Terminated: ok {rc=0} 05:46:44.133222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30930): Launched 05:46:44.435839 run osmo-hlr_10.42.42.2(pid=30931): Launched 05:46:44.551358 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:45.088696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30933): Launched 05:46:45.391951 run osmo-stp_10.42.42.5(pid=30934): Launched 05:46:45.507143 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:46.088600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30936): Launched 05:46:46.433280 run osmo-msc_10.42.42.6(pid=30937): Launched 05:46:46.875205 run osmo-stp_10.42.42.5(pid=30934): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30934)] 05:46:47.058027 run osmo-stp_10.42.42.5(pid=30934): stdout: | (launched: 2022-12-09_05:46:45.335762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:47.197916 run osmo-stp_10.42.42.5(pid=30934): stderr: | 20221209054645507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054645507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054645507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054645508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054645508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054645508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054645508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:47.335442 run osmo-stp_10.42.42.5(pid=30934): stdout: | (launched: 2022-12-09_05:46:45.335762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:47.464184 run osmo-stp_10.42.42.5(pid=30934): stderr: | 20221209054645507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054645507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054645507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054645508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054645508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054645508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054645508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:47.619813 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30934): Process ended prematurely: osmo-stp_10.42.42.5(pid=30934) [trial-2355↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30934)] [trial-2355↪ussd:trx-b200↪assert_extension.py:17] 05:46:47.628937 tst assert_extension.py:17: Test FAILED (6.3 sec) 05:46:47.656830 run osmo-hlr_10.42.42.2(pid=30931): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30931)] 05:46:47.708118 run osmo-hlr_10.42.42.2(pid=30931): stdout: | (launched: 2022-12-09_05:46:44.379887) 05:46:47.761318 run osmo-hlr_10.42.42.2(pid=30931): stderr: | 20221209054644558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054644558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054644558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054644558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054644558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054644558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054644571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054644581 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054644581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054644581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:47.835363 run osmo-msc_10.42.42.6(pid=30937): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30937)] 05:46:47.886513 run osmo-msc_10.42.42.6(pid=30937): stdout: | (launched: 2022-12-09_05:46:46.370304) 05:46:47.939248 run osmo-msc_10.42.42.6(pid=30937): stderr: | 20221209054646688 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054646688 DLGLOBAL DEBUG validating counter group 0x7f04d8fbfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054646688 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054646689 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054646689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054646689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054646691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054646691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054646691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054646691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:47.992684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30930): Terminating (SIGTERM) 05:46:48.035428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30933): Terminating (SIGTERM) 05:46:48.078336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30936): Terminating (SIGTERM) 05:46:48.121245 --- ParallelTerminationStrategy: PID 30930 died... 05:46:48.141719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30930): Terminated: ok {rc=0} 05:46:48.188798 --- ParallelTerminationStrategy: PID 30933 died... 05:46:48.209316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30933): Terminated: ok {rc=0} 05:46:48.256549 --- ParallelTerminationStrategy: PID 30936 died... 05:46:48.276346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30936): Terminated: ok {rc=0} 05:46:48.364939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:46:49.578239 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:46:49.584811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:46:49.618599 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:46:49.645079 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:46:49.697417 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:46:49.731097 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:46:49.757527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:46:50.306744 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:46:50.357184 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.368217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:46:50.439525 tst mo_mt_call.py: using LAC 19347 05:46:50.559058 tst mo_mt_call.py: using RAC 222 05:46:50.679383 tst mo_mt_call.py: using CellId 19347 05:46:50.799675 tst mo_mt_call.py: using BVCI 19348 05:46:50.910974 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.922113 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.933015 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.944154 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.955386 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:46:50.966648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:51.086999 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:46:51.207565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:46:51.719565 run create_hlr_db(pid=30942): Launched 05:46:51.853955 bus /sierra_2: Setting Powered False 05:46:52.919262 run create_hlr_db(pid=30942): Terminated: ok {rc=0} 05:46:53.358384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Launched 05:46:53.665572 run osmo-hlr_10.42.42.2(pid=30945): Launched 05:46:53.782381 run osmo-stp_10.42.42.5: Starting osmo-stp 05:46:54.325147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Launched 05:46:54.631842 run osmo-stp_10.42.42.5(pid=30948): Launched 05:46:54.752100 run osmo-msc_10.42.42.6: Starting osmo-msc 05:46:55.307873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30950): Launched 05:46:55.615597 run osmo-msc_10.42.42.6(pid=30951): Launched 05:46:55.787010 run osmo-stp_10.42.42.5(pid=30948): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30948)] 05:46:55.918828 run osmo-stp_10.42.42.5(pid=30948): stdout: | (launched: 2022-12-09_05:46:54.575504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:56.048675 run osmo-stp_10.42.42.5(pid=30948): stderr: | 20221209054654749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054654750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054654750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054654750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054654751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054654751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054654751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:56.176595 run osmo-stp_10.42.42.5(pid=30948): stdout: | (launched: 2022-12-09_05:46:54.575504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:46:56.298541 run osmo-stp_10.42.42.5(pid=30948): stderr: | 20221209054654749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054654750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054654750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054654750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054654751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054654751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054654751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:46:56.444055 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30948): Process ended prematurely: osmo-stp_10.42.42.5(pid=30948) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30948)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:46:56.453045 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:46:56.479815 run osmo-hlr_10.42.42.2(pid=30945): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30945)] 05:46:56.528666 run osmo-hlr_10.42.42.2(pid=30945): stdout: | (launched: 2022-12-09_05:46:53.608597) 05:46:56.579061 run osmo-hlr_10.42.42.2(pid=30945): stderr: | 20221209054653785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054653785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054653785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054653785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054653785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054653785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054653798 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054653806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054653807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054653807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:46:56.649171 run osmo-msc_10.42.42.6(pid=30951): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30951)] 05:46:56.697730 run osmo-msc_10.42.42.6(pid=30951): stdout: | (launched: 2022-12-09_05:46:55.558681) 05:46:56.747943 run osmo-msc_10.42.42.6(pid=30951): stderr: | 20221209054655833 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054655833 DLGLOBAL DEBUG validating counter group 0x7f08a08a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054655833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054655833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054655833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054655834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054655835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054655836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054655836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054655836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:46:56.798708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Terminating (SIGTERM) 05:46:56.839050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Terminating (SIGTERM) 05:46:56.879491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30950): Terminating (SIGTERM) 05:46:56.920129 --- ParallelTerminationStrategy: PID 30944 died... 05:46:56.939258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30944): Terminated: ok {rc=0} 05:46:56.983873 --- ParallelTerminationStrategy: PID 30947 died... 05:46:57.002521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30947): Terminated: ok {rc=0} 05:46:57.047462 --- ParallelTerminationStrategy: PID 30950 died... 05:46:57.066266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30950): Terminated: ok {rc=0} 05:46:57.155055 bus /sierra_3: Setting Powered False 05:46:58.256637 bus /sierra_3: Setting Powered False 05:46:59.374283 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:47:00.522769 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:00.534533 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:47:00.602834 tst mo_mt_call_osmux.py: using LAC 19348 05:47:00.720804 tst mo_mt_call_osmux.py: using RAC 223 05:47:00.846772 tst mo_mt_call_osmux.py: using CellId 19348 05:47:00.973600 tst mo_mt_call_osmux.py: using BVCI 19349 05:47:01.087947 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:01.100166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:01.112822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:01.124693 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:01.137149 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:47:01.149887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:01.267920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:47:01.406188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:01.968358 run create_hlr_db(pid=30953): Launched 05:47:02.139412 bus /sierra_2: Setting Powered False 05:47:03.203506 run create_hlr_db(pid=30953): Terminated: ok {rc=0} 05:47:03.661059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Launched 05:47:03.989017 run osmo-hlr_10.42.42.2(pid=30956): Launched 05:47:04.113714 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:04.680344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Launched 05:47:05.009041 run osmo-stp_10.42.42.5(pid=30959): Launched 05:47:05.133300 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:05.727555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30961): Launched 05:47:06.055640 run osmo-msc_10.42.42.6(pid=30962): Launched 05:47:06.237907 run osmo-stp_10.42.42.5(pid=30959): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] 05:47:06.382110 run osmo-stp_10.42.42.5(pid=30959): stdout: | (launched: 2022-12-09_05:47:04.948588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:06.520080 run osmo-stp_10.42.42.5(pid=30959): stderr: | 20221209054705142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054705142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054705142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054705143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054705143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054705143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054705143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:06.657929 run osmo-stp_10.42.42.5(pid=30959): stdout: | (launched: 2022-12-09_05:47:04.948588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:06.788029 run osmo-stp_10.42.42.5(pid=30959): stderr: | 20221209054705142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054705142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054705142 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054705143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054705143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054705143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054705143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:06.943667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30959): Process ended prematurely: osmo-stp_10.42.42.5(pid=30959) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:47:06.953469 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 05:47:06.981233 run osmo-hlr_10.42.42.2(pid=30956): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30956)] 05:47:07.031514 run osmo-hlr_10.42.42.2(pid=30956): stdout: | (launched: 2022-12-09_05:47:03.929261) 05:47:07.083692 run osmo-hlr_10.42.42.2(pid=30956): stderr: | 20221209054704129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054704129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054704129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054704129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054704129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054704129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054704142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054704150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054704151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054704151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:07.156192 run osmo-msc_10.42.42.6(pid=30962): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30962)] 05:47:07.206208 run osmo-msc_10.42.42.6(pid=30962): stdout: | (launched: 2022-12-09_05:47:05.995421) 05:47:07.258052 run osmo-msc_10.42.42.6(pid=30962): stderr: | 20221209054706319 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054706319 DLGLOBAL DEBUG validating counter group 0x7f657b8cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054706320 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054706320 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054706320 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054706320 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054706322 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054706322 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054706322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054706322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:07.310173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Terminating (SIGTERM) 05:47:07.352000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Terminating (SIGTERM) 05:47:07.394100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30961): Terminating (SIGTERM) 05:47:07.436557 --- ParallelTerminationStrategy: PID 30955 died... 05:47:07.456667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30955): Terminated: ok {rc=0} 05:47:07.503085 --- ParallelTerminationStrategy: PID 30958 died... 05:47:07.522745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30958): Terminated: ok {rc=0} 05:47:07.569374 --- ParallelTerminationStrategy: PID 30961 died... 05:47:07.589273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30961): Terminated: ok {rc=0} 05:47:07.676918 bus /sierra_3: Setting Powered False 05:47:08.777516 bus /sierra_3: Setting Powered False 05:47:09.894214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:47:11.150775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:11.157242 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:47:11.191475 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:47:11.217982 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:47:11.267650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:47:11.300651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:47:11.327455 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:47:11.884646 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:47:11.937634 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:11.949519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:47:12.019045 tst mo_mt_call.py: using LAC 19349 05:47:12.146465 tst mo_mt_call.py: using RAC 224 05:47:12.266506 tst mo_mt_call.py: using CellId 19349 05:47:12.386360 tst mo_mt_call.py: using BVCI 19350 05:47:12.499750 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:12.510854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:12.521947 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:12.533033 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:12.544177 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:12.555366 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:12.670144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:12.789464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:13.303498 run create_hlr_db(pid=30967): Launched 05:47:13.427928 bus /sierra_2: Setting Powered False 05:47:14.489477 run create_hlr_db(pid=30967): Terminated: ok {rc=0} 05:47:14.918010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Launched 05:47:15.224228 run osmo-hlr_10.42.42.2(pid=30970): Launched 05:47:15.341133 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:15.919122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Launched 05:47:16.267191 run osmo-stp_10.42.42.5(pid=30973): Launched 05:47:16.535372 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:17.160175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Launched 05:47:17.473429 run osmo-msc_10.42.42.6(pid=30976): Launched 05:47:17.646279 run osmo-stp_10.42.42.5(pid=30973): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] 05:47:17.777890 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-09_05:47:16.206248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:17.908234 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221209054716465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054716465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054716465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054716466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054716466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054716466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054716466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:18.036482 run osmo-stp_10.42.42.5(pid=30973): stdout: | (launched: 2022-12-09_05:47:16.206248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:18.158193 run osmo-stp_10.42.42.5(pid=30973): stderr: | 20221209054716465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054716465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054716465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054716466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054716466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054716466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054716466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:18.303997 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:47:18.313000 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:47:18.339733 run osmo-hlr_10.42.42.2(pid=30970): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30970)] 05:47:18.388481 run osmo-hlr_10.42.42.2(pid=30970): stdout: | (launched: 2022-12-09_05:47:15.167375) 05:47:18.438664 run osmo-hlr_10.42.42.2(pid=30970): stderr: | 20221209054715344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054715344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054715344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054715344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054715345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054715345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054715356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054715365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054715365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054715365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:18.508589 run osmo-msc_10.42.42.6(pid=30976): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30976)] 05:47:18.557220 run osmo-msc_10.42.42.6(pid=30976): stdout: | (launched: 2022-12-09_05:47:17.416218) 05:47:18.607481 run osmo-msc_10.42.42.6(pid=30976): stderr: | 20221209054717690 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054717690 DLGLOBAL DEBUG validating counter group 0x7f01d447cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054717690 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054717690 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054717690 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054717691 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054717694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054717694 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054717695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054717695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:18.658105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminating (SIGTERM) 05:47:18.698810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminating (SIGTERM) 05:47:18.739597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Terminating (SIGTERM) 05:47:18.780384 --- ParallelTerminationStrategy: PID 30969 died... 05:47:18.799660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30969): Terminated: ok {rc=0} 05:47:18.844873 --- ParallelTerminationStrategy: PID 30972 died... 05:47:18.864118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30972): Terminated: ok {rc=0} 05:47:18.909465 --- ParallelTerminationStrategy: PID 30975 died... 05:47:18.928368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30975): Terminated: ok {rc=0} 05:47:19.013451 bus /sierra_3: Setting Powered False 05:47:20.114549 bus /sierra_3: Setting Powered False 05:47:21.236584 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:47:22.390953 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:22.403350 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:47:22.475278 tst mo_mt_call_osmux.py: using LAC 19350 05:47:22.607613 tst mo_mt_call_osmux.py: using RAC 225 05:47:22.740176 tst mo_mt_call_osmux.py: using CellId 19350 05:47:22.871517 tst mo_mt_call_osmux.py: using BVCI 19351 05:47:22.992826 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:23.004578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:23.016233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:23.028254 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:23.040112 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:47:23.051793 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:23.172907 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:47:23.292193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:23.805606 run create_hlr_db(pid=30978): Launched 05:47:23.939805 bus /sierra_2: Setting Powered False 05:47:25.004497 run create_hlr_db(pid=30978): Terminated: ok {rc=0} 05:47:25.445273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30980): Launched 05:47:25.754661 run osmo-hlr_10.42.42.2(pid=30981): Launched 05:47:25.871927 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:26.400595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30983): Launched 05:47:26.708372 run osmo-stp_10.42.42.5(pid=30984): Launched 05:47:26.825256 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:27.386735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30986): Launched 05:47:27.694164 run osmo-msc_10.42.42.6(pid=30987): Launched 05:47:27.865287 run osmo-stp_10.42.42.5(pid=30984): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30984)] 05:47:27.996364 run osmo-stp_10.42.42.5(pid=30984): stdout: | (launched: 2022-12-09_05:47:26.651651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:28.126866 run osmo-stp_10.42.42.5(pid=30984): stderr: | 20221209054726823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054726823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054726823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054726823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054726824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054726824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054726824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:28.255083 run osmo-stp_10.42.42.5(pid=30984): stdout: | (launched: 2022-12-09_05:47:26.651651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:28.376390 run osmo-stp_10.42.42.5(pid=30984): stderr: | 20221209054726823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054726823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054726823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054726823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054726824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054726824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054726824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:28.522048 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30984): Process ended prematurely: osmo-stp_10.42.42.5(pid=30984) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30984)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:47:28.531008 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:47:28.558709 run osmo-hlr_10.42.42.2(pid=30981): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30981)] 05:47:28.607791 run osmo-hlr_10.42.42.2(pid=30981): stdout: | (launched: 2022-12-09_05:47:25.697860) 05:47:28.657994 run osmo-hlr_10.42.42.2(pid=30981): stderr: | 20221209054725878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054725878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054725878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054725878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054725879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054725879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054725890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054725899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054725899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054725899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:28.727903 run osmo-msc_10.42.42.6(pid=30987): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30987)] 05:47:28.776327 run osmo-msc_10.42.42.6(pid=30987): stdout: | (launched: 2022-12-09_05:47:27.637640) 05:47:28.826769 run osmo-msc_10.42.42.6(pid=30987): stderr: | 20221209054727912 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054727912 DLGLOBAL DEBUG validating counter group 0x7f8758b40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054727912 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054727912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054727912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054727912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054727914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054727915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054727915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054727915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:28.877503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30980): Terminating (SIGTERM) 05:47:28.918049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30983): Terminating (SIGTERM) 05:47:28.958550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30986): Terminating (SIGTERM) 05:47:28.999000 --- ParallelTerminationStrategy: PID 30980 died... 05:47:29.017786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30980): Terminated: ok {rc=0} 05:47:29.062597 --- ParallelTerminationStrategy: PID 30983 died... 05:47:29.081256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30983): Terminated: ok {rc=0} 05:47:29.126468 --- ParallelTerminationStrategy: PID 30986 died... 05:47:29.145147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30986): Terminated: ok {rc=0} 05:47:29.232340 bus /sierra_3: Setting Powered False 05:47:30.331802 bus /sierra_3: Setting Powered False 05:47:31.450773 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:47:32.708422 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:32.714940 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:47:32.748349 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:47:32.774785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:47:32.827619 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:47:32.860682 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:47:32.887133 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:47:33.440934 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:47:33.491717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:33.502916 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:47:33.572408 tst mo_mt_call.py: using LAC 19351 05:47:33.703771 tst mo_mt_call.py: using RAC 226 05:47:33.833960 tst mo_mt_call.py: using CellId 19351 05:47:33.964192 tst mo_mt_call.py: using BVCI 19352 05:47:34.085755 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:34.097692 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:34.109294 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:34.120912 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:34.132512 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:34.144272 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:34.263596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:34.379959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:34.859011 run create_hlr_db(pid=30992): Launched 05:47:34.976933 bus /sierra_2: Setting Powered False 05:47:36.038767 run create_hlr_db(pid=30992): Terminated: ok {rc=0} 05:47:36.488031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Launched 05:47:36.817954 run osmo-hlr_10.42.42.2(pid=30995): Launched 05:47:36.942454 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:37.513315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Launched 05:47:37.843732 run osmo-stp_10.42.42.5(pid=30998): Launched 05:47:37.968835 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:38.564803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Launched 05:47:38.894861 run osmo-msc_10.42.42.6(pid=31001): Launched 05:47:39.077429 run osmo-stp_10.42.42.5(pid=30998): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] 05:47:39.216246 run osmo-stp_10.42.42.5(pid=30998): stdout: | (launched: 2022-12-09_05:47:37.783317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:39.354979 run osmo-stp_10.42.42.5(pid=30998): stderr: | 20221209054737976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054737976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054737977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054737977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054737977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054737978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054737978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:39.492925 run osmo-stp_10.42.42.5(pid=30998): stdout: | (launched: 2022-12-09_05:47:37.783317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:39.623791 run osmo-stp_10.42.42.5(pid=30998): stderr: | 20221209054737976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054737976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054737977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054737977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054737977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054737978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054737978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:39.780457 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30998): Process ended prematurely: osmo-stp_10.42.42.5(pid=30998) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:47:39.790455 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:47:39.818580 run osmo-hlr_10.42.42.2(pid=30995): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30995)] 05:47:39.869228 run osmo-hlr_10.42.42.2(pid=30995): stdout: | (launched: 2022-12-09_05:47:36.757821) 05:47:39.922069 run osmo-hlr_10.42.42.2(pid=30995): stderr: | 20221209054736957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054736957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054736957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054736957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054736957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054736957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054736969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054736977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054736978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054736978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:39.995479 run osmo-msc_10.42.42.6(pid=31001): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31001)] 05:47:40.046399 run osmo-msc_10.42.42.6(pid=31001): stdout: | (launched: 2022-12-09_05:47:38.834638) 05:47:40.098925 run osmo-msc_10.42.42.6(pid=31001): stderr: | 20221209054739160 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054739160 DLGLOBAL DEBUG validating counter group 0x7f94167a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054739160 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054739160 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054739160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054739160 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054739162 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054739162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054739163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054739163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:40.151908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Terminating (SIGTERM) 05:47:40.194001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Terminating (SIGTERM) 05:47:40.236454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Terminating (SIGTERM) 05:47:40.279144 --- ParallelTerminationStrategy: PID 30994 died... 05:47:40.299012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Terminated: ok {rc=0} 05:47:40.345873 --- ParallelTerminationStrategy: PID 30997 died... 05:47:40.365677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Terminated: ok {rc=0} 05:47:40.412320 --- ParallelTerminationStrategy: PID 31000 died... 05:47:40.432237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Terminated: ok {rc=0} 05:47:40.521469 bus /sierra_3: Setting Powered False 05:47:41.622827 bus /sierra_3: Setting Powered False 05:47:42.739934 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:47:43.886232 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:43.898128 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:47:43.968129 tst mo_mt_call_osmux.py: using LAC 19352 05:47:44.090787 tst mo_mt_call_osmux.py: using RAC 227 05:47:44.213281 tst mo_mt_call_osmux.py: using CellId 19352 05:47:44.334316 tst mo_mt_call_osmux.py: using BVCI 19353 05:47:44.446381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:44.457568 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:44.468542 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:44.479710 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:44.490951 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:47:44.502106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:44.620217 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:47:44.737501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:45.216084 run create_hlr_db(pid=31003): Launched 05:47:45.333430 bus /sierra_2: Setting Powered False 05:47:46.398303 run create_hlr_db(pid=31003): Terminated: ok {rc=0} 05:47:46.863985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Launched 05:47:47.258462 run osmo-hlr_10.42.42.2(pid=31006): Launched 05:47:47.383888 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:47.955620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Launched 05:47:48.285297 run osmo-stp_10.42.42.5(pid=31009): Launched 05:47:48.411230 run osmo-msc_10.42.42.6: Starting osmo-msc 05:47:49.009520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Launched 05:47:49.339565 run osmo-msc_10.42.42.6(pid=31012): Launched 05:47:49.523446 run osmo-stp_10.42.42.5(pid=31009): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] 05:47:49.663872 run osmo-stp_10.42.42.5(pid=31009): stdout: | (launched: 2022-12-09_05:47:48.224818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:49.803167 run osmo-stp_10.42.42.5(pid=31009): stderr: | 20221209054748420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054748420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054748420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054748420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054748421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054748421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054748421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:49.941500 run osmo-stp_10.42.42.5(pid=31009): stdout: | (launched: 2022-12-09_05:47:48.224818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:47:50.072504 run osmo-stp_10.42.42.5(pid=31009): stderr: | 20221209054748420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054748420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054748420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054748420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054748421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054748421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054748421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:47:50.229136 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31009): Process ended prematurely: osmo-stp_10.42.42.5(pid=31009) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:47:50.238802 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:47:50.267050 run osmo-hlr_10.42.42.2(pid=31006): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31006)] 05:47:50.318236 run osmo-hlr_10.42.42.2(pid=31006): stdout: | (launched: 2022-12-09_05:47:47.197898) 05:47:50.371343 run osmo-hlr_10.42.42.2(pid=31006): stderr: | 20221209054747399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054747399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054747399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054747399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054747399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054747400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054747412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054747420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054747420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054747421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:47:50.445186 run osmo-msc_10.42.42.6(pid=31012): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31012)] 05:47:50.495999 run osmo-msc_10.42.42.6(pid=31012): stdout: | (launched: 2022-12-09_05:47:49.278733) 05:47:50.548516 run osmo-msc_10.42.42.6(pid=31012): stderr: | 20221209054749604 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054749604 DLGLOBAL DEBUG validating counter group 0x7f77488e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054749605 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054749605 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054749605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054749605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054749607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054749607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054749607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054749607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:47:50.601919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Terminating (SIGTERM) 05:47:50.644550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Terminating (SIGTERM) 05:47:50.687204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Terminating (SIGTERM) 05:47:50.730531 --- ParallelTerminationStrategy: PID 31005 died... 05:47:50.750965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Terminated: ok {rc=0} 05:47:50.798133 --- ParallelTerminationStrategy: PID 31008 died... 05:47:50.817945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Terminated: ok {rc=0} 05:47:50.864808 --- ParallelTerminationStrategy: PID 31011 died... 05:47:50.885233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Terminated: ok {rc=0} 05:47:50.975496 bus /sierra_3: Setting Powered False 05:47:52.075960 bus /sierra_3: Setting Powered False 05:47:53.195026 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:47:54.445799 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:47:54.452298 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:47:54.485995 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:47:54.512723 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:47:54.570801 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:47:54.605547 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:47:54.633189 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:47:55.177996 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:47:55.231077 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.242915 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:47:55.313095 tst mo_mt_call.py: using LAC 19353 05:47:55.440414 tst mo_mt_call.py: using RAC 228 05:47:55.568058 tst mo_mt_call.py: using CellId 19353 05:47:55.695902 tst mo_mt_call.py: using BVCI 19354 05:47:55.815309 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.827068 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.838694 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.850315 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.862082 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:47:55.873737 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:55.991832 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:47:56.108208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:47:56.586533 run create_hlr_db(pid=31017): Launched 05:47:56.704449 bus /sierra_2: Setting Powered False 05:47:57.766188 run create_hlr_db(pid=31017): Terminated: ok {rc=0} 05:47:58.194200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31019): Launched 05:47:58.502608 run osmo-hlr_10.42.42.2(pid=31020): Launched 05:47:58.620101 run osmo-stp_10.42.42.5: Starting osmo-stp 05:47:59.163048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31022): Launched 05:47:59.469811 run osmo-stp_10.42.42.5(pid=31023): Launched 05:47:59.587682 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:00.148278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31025): Launched 05:48:00.456578 run osmo-msc_10.42.42.6(pid=31026): Launched 05:48:00.630374 run osmo-stp_10.42.42.5(pid=31023): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31023)] 05:48:00.762372 run osmo-stp_10.42.42.5(pid=31023): stdout: | (launched: 2022-12-09_05:47:59.413131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:00.918627 run osmo-stp_10.42.42.5(pid=31023): stderr: | 20221209054759586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054759586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054759586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054759587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054759587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054759587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054759587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:01.050310 run osmo-stp_10.42.42.5(pid=31023): stdout: | (launched: 2022-12-09_05:47:59.413131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:01.175733 run osmo-stp_10.42.42.5(pid=31023): stderr: | 20221209054759586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054759586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054759586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054759587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054759587 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054759587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054759587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:01.326149 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31023): Process ended prematurely: osmo-stp_10.42.42.5(pid=31023) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31023)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:48:01.336156 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 05:48:01.364672 run osmo-hlr_10.42.42.2(pid=31020): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31020)] 05:48:01.415484 run osmo-hlr_10.42.42.2(pid=31020): stdout: | (launched: 2022-12-09_05:47:58.445529) 05:48:01.467301 run osmo-hlr_10.42.42.2(pid=31020): stderr: | 20221209054758623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054758623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054758623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054758623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054758623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054758624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054758639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054758649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054758649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054758649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:01.539033 run osmo-msc_10.42.42.6(pid=31026): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31026)] 05:48:01.589624 run osmo-msc_10.42.42.6(pid=31026): stdout: | (launched: 2022-12-09_05:48:00.399816) 05:48:01.641846 run osmo-msc_10.42.42.6(pid=31026): stderr: | 20221209054800674 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054800675 DLGLOBAL DEBUG validating counter group 0x7fa49c8c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054800675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054800675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054800675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054800675 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054800677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054800677 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054800678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054800678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:01.695083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31019): Terminating (SIGTERM) 05:48:01.738152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31022): Terminating (SIGTERM) 05:48:01.781028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31025): Terminating (SIGTERM) 05:48:01.824037 --- ParallelTerminationStrategy: PID 31019 died... 05:48:01.843948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31019): Terminated: ok {rc=0} 05:48:01.891917 --- ParallelTerminationStrategy: PID 31022 died... 05:48:01.911854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31022): Terminated: ok {rc=0} 05:48:01.960093 --- ParallelTerminationStrategy: PID 31025 died... 05:48:01.979941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31025): Terminated: ok {rc=0} 05:48:02.074881 bus /sierra_3: Setting Powered False 05:48:03.182977 bus /sierra_3: Setting Powered False 05:48:04.299816 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:48:05.447439 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:05.459221 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:48:05.529131 tst mo_mt_call_osmux.py: using LAC 19354 05:48:05.650404 tst mo_mt_call_osmux.py: using RAC 229 05:48:05.772879 tst mo_mt_call_osmux.py: using CellId 19354 05:48:05.895345 tst mo_mt_call_osmux.py: using BVCI 19355 05:48:06.009454 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:06.020428 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:06.031366 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:06.042920 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:06.054567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:48:06.066734 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:06.189660 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:48:06.310367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:06.824270 run create_hlr_db(pid=31028): Launched 05:48:06.958376 bus /sierra_2: Setting Powered False 05:48:08.023416 run create_hlr_db(pid=31028): Terminated: ok {rc=0} 05:48:08.463618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31030): Launched 05:48:08.771181 run osmo-hlr_10.42.42.2(pid=31031): Launched 05:48:08.889228 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:09.437336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31033): Launched 05:48:09.746769 run osmo-stp_10.42.42.5(pid=31034): Launched 05:48:09.864150 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:10.419722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31036): Launched 05:48:10.727785 run osmo-msc_10.42.42.6(pid=31037): Launched 05:48:10.900029 run osmo-stp_10.42.42.5(pid=31034): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31034)] 05:48:11.030824 run osmo-stp_10.42.42.5(pid=31034): stdout: | (launched: 2022-12-09_05:48:09.689566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:11.161076 run osmo-stp_10.42.42.5(pid=31034): stderr: | 20221209054809864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054809864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054809864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054809864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054809865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054809865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054809865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:11.288789 run osmo-stp_10.42.42.5(pid=31034): stdout: | (launched: 2022-12-09_05:48:09.689566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:11.410205 run osmo-stp_10.42.42.5(pid=31034): stderr: | 20221209054809864 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054809864 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054809864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054809864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054809865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054809865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054809865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:11.556301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31034): Process ended prematurely: osmo-stp_10.42.42.5(pid=31034) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31034)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:48:11.565341 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:48:11.592323 run osmo-hlr_10.42.42.2(pid=31031): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31031)] 05:48:11.641534 run osmo-hlr_10.42.42.2(pid=31031): stdout: | (launched: 2022-12-09_05:48:08.714314) 05:48:11.692133 run osmo-hlr_10.42.42.2(pid=31031): stderr: | 20221209054808895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054808895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054808895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054808895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054808895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054808895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054808908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054808917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054808917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054808917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:11.762629 run osmo-msc_10.42.42.6(pid=31037): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31037)] 05:48:11.811519 run osmo-msc_10.42.42.6(pid=31037): stdout: | (launched: 2022-12-09_05:48:10.671148) 05:48:11.862045 run osmo-msc_10.42.42.6(pid=31037): stderr: | 20221209054810946 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054810946 DLGLOBAL DEBUG validating counter group 0x7f8f79b6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054810947 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054810947 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054810947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054810947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054810949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054810949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054810949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054810949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:11.913015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31030): Terminating (SIGTERM) 05:48:11.953783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31033): Terminating (SIGTERM) 05:48:11.994568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31036): Terminating (SIGTERM) 05:48:12.035659 --- ParallelTerminationStrategy: PID 31030 died... 05:48:12.055102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31030): Terminated: ok {rc=0} 05:48:12.100497 --- ParallelTerminationStrategy: PID 31033 died... 05:48:12.119481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31033): Terminated: ok {rc=0} 05:48:12.164670 --- ParallelTerminationStrategy: PID 31036 died... 05:48:12.183689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31036): Terminated: ok {rc=0} 05:48:12.269033 bus /sierra_3: Setting Powered False 05:48:13.366507 bus /sierra_3: Setting Powered False 05:48:14.482797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:48:15.732234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:15.738689 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:48:15.772313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:48:15.799371 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:48:15.867108 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:48:15.909774 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:48:15.948903 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:48:16.476521 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:48:16.534072 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:16.546332 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:48:16.619375 tst mo_mt_call.py: using LAC 19355 05:48:16.750585 tst mo_mt_call.py: using RAC 230 05:48:16.913844 tst mo_mt_call.py: using CellId 19355 05:48:17.082477 tst mo_mt_call.py: using BVCI 19356 05:48:17.206803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:17.219055 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:17.231212 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:17.243361 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:17.255379 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:17.267647 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:17.393737 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:17.513998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:18.030500 run create_hlr_db(pid=31042): Launched 05:48:18.164375 bus /sierra_2: Setting Powered False 05:48:19.229576 run create_hlr_db(pid=31042): Terminated: ok {rc=0} 05:48:19.670757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Launched 05:48:19.978631 run osmo-hlr_10.42.42.2(pid=31045): Launched 05:48:20.095315 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:20.622677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Launched 05:48:20.930337 run osmo-stp_10.42.42.5(pid=31048): Launched 05:48:21.047484 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:21.616273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31050): Launched 05:48:21.925865 run osmo-msc_10.42.42.6(pid=31051): Launched 05:48:22.097545 run osmo-stp_10.42.42.5(pid=31048): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] 05:48:22.228466 run osmo-stp_10.42.42.5(pid=31048): stdout: | (launched: 2022-12-09_05:48:20.873711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:22.358677 run osmo-stp_10.42.42.5(pid=31048): stderr: | 20221209054821047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054821047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054821047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054821048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054821048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054821048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054821048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:22.487173 run osmo-stp_10.42.42.5(pid=31048): stdout: | (launched: 2022-12-09_05:48:20.873711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:22.609222 run osmo-stp_10.42.42.5(pid=31048): stderr: | 20221209054821047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054821047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054821047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054821048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054821048 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054821048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054821048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:22.755076 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31048): Process ended prematurely: osmo-stp_10.42.42.5(pid=31048) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:48:22.763941 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:48:22.791146 run osmo-hlr_10.42.42.2(pid=31045): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31045)] 05:48:22.839920 run osmo-hlr_10.42.42.2(pid=31045): stdout: | (launched: 2022-12-09_05:48:19.921768) 05:48:22.890159 run osmo-hlr_10.42.42.2(pid=31045): stderr: | 20221209054820102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054820102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054820102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054820102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054820102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054820102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054820115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054820126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054820126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054820126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:22.960001 run osmo-msc_10.42.42.6(pid=31051): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31051)] 05:48:23.008369 run osmo-msc_10.42.42.6(pid=31051): stdout: | (launched: 2022-12-09_05:48:21.868607) 05:48:23.058288 run osmo-msc_10.42.42.6(pid=31051): stderr: | 20221209054822142 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054822143 DLGLOBAL DEBUG validating counter group 0x7f47db626c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054822143 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054822143 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054822143 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054822143 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054822145 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054822145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054822145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054822146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:23.108659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Terminating (SIGTERM) 05:48:23.149132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Terminating (SIGTERM) 05:48:23.189571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31050): Terminating (SIGTERM) 05:48:23.230079 --- ParallelTerminationStrategy: PID 31044 died... 05:48:23.249260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31044): Terminated: ok {rc=0} 05:48:23.294261 --- ParallelTerminationStrategy: PID 31047 died... 05:48:23.312898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31047): Terminated: ok {rc=0} 05:48:23.358357 --- ParallelTerminationStrategy: PID 31050 died... 05:48:23.377236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31050): Terminated: ok {rc=0} 05:48:23.465037 bus /sierra_3: Setting Powered False 05:48:24.567228 bus /sierra_3: Setting Powered False 05:48:25.686232 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:48:26.838798 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:26.851073 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:48:26.923278 tst mo_mt_call_osmux.py: using LAC 19356 05:48:27.054538 tst mo_mt_call_osmux.py: using RAC 231 05:48:27.183081 tst mo_mt_call_osmux.py: using CellId 19356 05:48:27.313129 tst mo_mt_call_osmux.py: using BVCI 19357 05:48:27.433230 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:27.444799 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:27.456276 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:27.467715 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:27.479308 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:48:27.490767 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:27.611068 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:48:27.734259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:28.246627 run create_hlr_db(pid=31053): Launched 05:48:28.379131 bus /sierra_2: Setting Powered False 05:48:29.443819 run create_hlr_db(pid=31053): Terminated: ok {rc=0} 05:48:29.902605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Launched 05:48:30.232212 run osmo-hlr_10.42.42.2(pid=31056): Launched 05:48:30.356906 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:30.935740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Launched 05:48:31.293753 run osmo-stp_10.42.42.5(pid=31059): Launched 05:48:31.476626 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:32.245682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Launched 05:48:32.583318 run osmo-msc_10.42.42.6(pid=31062): Launched 05:48:32.766024 run osmo-stp_10.42.42.5(pid=31059): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] 05:48:32.905289 run osmo-stp_10.42.42.5(pid=31059): stdout: | (launched: 2022-12-09_05:48:31.232458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:33.044856 run osmo-stp_10.42.42.5(pid=31059): stderr: | 20221209054831567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054831567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054831567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054831567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054831568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054831568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054831568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:33.183406 run osmo-stp_10.42.42.5(pid=31059): stdout: | (launched: 2022-12-09_05:48:31.232458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:33.313554 run osmo-stp_10.42.42.5(pid=31059): stderr: | 20221209054831567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054831567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054831567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054831567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054831568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054831568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054831568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:33.470167 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31059): Process ended prematurely: osmo-stp_10.42.42.5(pid=31059) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:48:33.479658 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:48:33.507462 run osmo-hlr_10.42.42.2(pid=31056): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31056)] 05:48:33.557906 run osmo-hlr_10.42.42.2(pid=31056): stdout: | (launched: 2022-12-09_05:48:30.171682) 05:48:33.610581 run osmo-hlr_10.42.42.2(pid=31056): stderr: | 20221209054830372 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054830373 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054830373 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054830373 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054830373 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054830373 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054830386 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054830394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054830394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054830394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:33.683380 run osmo-msc_10.42.42.6(pid=31062): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31062)] 05:48:33.733807 run osmo-msc_10.42.42.6(pid=31062): stdout: | (launched: 2022-12-09_05:48:32.522884) 05:48:33.785903 run osmo-msc_10.42.42.6(pid=31062): stderr: | 20221209054832847 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054832847 DLGLOBAL DEBUG validating counter group 0x7f587350dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054832847 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054832848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054832848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054832848 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054832850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054832850 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054832850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054832850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:33.838206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Terminating (SIGTERM) 05:48:33.880327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Terminating (SIGTERM) 05:48:33.922569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Terminating (SIGTERM) 05:48:33.964851 --- ParallelTerminationStrategy: PID 31055 died... 05:48:33.984901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31055): Terminated: ok {rc=0} 05:48:34.031321 --- ParallelTerminationStrategy: PID 31058 died... 05:48:34.050994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31058): Terminated: ok {rc=0} 05:48:34.097361 --- ParallelTerminationStrategy: PID 31061 died... 05:48:34.117014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31061): Terminated: ok {rc=0} 05:48:34.205226 bus /sierra_3: Setting Powered False 05:48:35.306136 bus /sierra_3: Setting Powered False 05:48:36.424464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:48:37.673849 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:37.682210 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:48:37.716410 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:48:37.743643 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:48:37.796501 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:48:37.830601 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:48:37.858032 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:48:38.415679 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:48:38.467869 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:38.479813 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:48:38.555695 tst mo_mt_call.py: using LAC 19357 05:48:38.684825 tst mo_mt_call.py: using RAC 232 05:48:38.812791 tst mo_mt_call.py: using CellId 19357 05:48:38.940302 tst mo_mt_call.py: using BVCI 19358 05:48:39.061694 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:39.073407 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:39.085218 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:39.096693 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:39.108390 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:39.119895 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:39.240358 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:39.358201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:39.870213 run create_hlr_db(pid=31067): Launched 05:48:40.002800 bus /sierra_2: Setting Powered False 05:48:41.066929 run create_hlr_db(pid=31067): Terminated: ok {rc=0} 05:48:41.506080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Launched 05:48:41.814839 run osmo-hlr_10.42.42.2(pid=31070): Launched 05:48:41.931498 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:42.474842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31072): Launched 05:48:42.782998 run osmo-stp_10.42.42.5(pid=31073): Launched 05:48:42.900243 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:43.456128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31075): Launched 05:48:43.763706 run osmo-msc_10.42.42.6(pid=31076): Launched 05:48:43.936529 run osmo-stp_10.42.42.5(pid=31073): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31073)] 05:48:44.067991 run osmo-stp_10.42.42.5(pid=31073): stdout: | (launched: 2022-12-09_05:48:42.725762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:44.198393 run osmo-stp_10.42.42.5(pid=31073): stderr: | 20221209054842896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054842897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054842897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054842897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054842898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054842898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054842898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:44.326373 run osmo-stp_10.42.42.5(pid=31073): stdout: | (launched: 2022-12-09_05:48:42.725762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:44.448148 run osmo-stp_10.42.42.5(pid=31073): stderr: | 20221209054842896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054842897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054842897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054842897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054842898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054842898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054842898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:44.594087 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31073): Process ended prematurely: osmo-stp_10.42.42.5(pid=31073) [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31073)] [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:48:44.603090 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:48:44.630111 run osmo-hlr_10.42.42.2(pid=31070): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31070)] 05:48:44.678675 run osmo-hlr_10.42.42.2(pid=31070): stdout: | (launched: 2022-12-09_05:48:41.757868) 05:48:44.728785 run osmo-hlr_10.42.42.2(pid=31070): stderr: | 20221209054841935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054841935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054841935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054841935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054841935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054841935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054841947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054841956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054841956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054841957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:44.798650 run osmo-msc_10.42.42.6(pid=31076): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31076)] 05:48:44.846964 run osmo-msc_10.42.42.6(pid=31076): stdout: | (launched: 2022-12-09_05:48:43.706859) 05:48:44.897250 run osmo-msc_10.42.42.6(pid=31076): stderr: | 20221209054843980 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054843981 DLGLOBAL DEBUG validating counter group 0x7f92f28fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054843981 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054843982 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054843982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054843982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054843984 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054843984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054843985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054843985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:44.947453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Terminating (SIGTERM) 05:48:44.988067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31072): Terminating (SIGTERM) 05:48:45.028552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31075): Terminating (SIGTERM) 05:48:45.069237 --- ParallelTerminationStrategy: PID 31069 died... 05:48:45.088559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31069): Terminated: ok {rc=0} 05:48:45.133813 --- ParallelTerminationStrategy: PID 31072 died... 05:48:45.152682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31072): Terminated: ok {rc=0} 05:48:45.197610 --- ParallelTerminationStrategy: PID 31075 died... 05:48:45.216556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31075): Terminated: ok {rc=0} 05:48:45.304658 bus /sierra_3: Setting Powered False 05:48:46.405073 bus /sierra_3: Setting Powered False 05:48:47.523544 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:48:48.672464 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:48.684481 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:48:48.754018 tst mo_mt_call_osmux.py: using LAC 19358 05:48:48.873921 tst mo_mt_call_osmux.py: using RAC 233 05:48:48.996002 tst mo_mt_call_osmux.py: using CellId 19358 05:48:49.121811 tst mo_mt_call_osmux.py: using BVCI 19359 05:48:49.235042 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:49.246445 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:49.257439 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:49.268578 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:49.279807 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:48:49.291029 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:49.411796 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:48:49.532644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:48:50.046224 run create_hlr_db(pid=31078): Launched 05:48:50.180468 bus /sierra_2: Setting Powered False 05:48:51.245029 run create_hlr_db(pid=31078): Terminated: ok {rc=0} 05:48:51.704840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31080): Launched 05:48:52.034164 run osmo-hlr_10.42.42.2(pid=31081): Launched 05:48:52.159243 run osmo-stp_10.42.42.5: Starting osmo-stp 05:48:52.726884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31083): Launched 05:48:53.056508 run osmo-stp_10.42.42.5(pid=31084): Launched 05:48:53.181500 run osmo-msc_10.42.42.6: Starting osmo-msc 05:48:53.776764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31086): Launched 05:48:54.105696 run osmo-msc_10.42.42.6(pid=31087): Launched 05:48:54.289334 run osmo-stp_10.42.42.5(pid=31084): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31084)] 05:48:54.428665 run osmo-stp_10.42.42.5(pid=31084): stdout: | (launched: 2022-12-09_05:48:52.995883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:54.567763 run osmo-stp_10.42.42.5(pid=31084): stderr: | 20221209054853191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054853191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054853192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054853192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054853195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054853195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054853195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:54.706022 run osmo-stp_10.42.42.5(pid=31084): stdout: | (launched: 2022-12-09_05:48:52.995883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:48:54.836256 run osmo-stp_10.42.42.5(pid=31084): stderr: | 20221209054853191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054853191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054853192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054853192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054853195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054853195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054853195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:48:54.992591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31084): Process ended prematurely: osmo-stp_10.42.42.5(pid=31084) [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31084)] [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:48:55.002210 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 05:48:55.029962 run osmo-hlr_10.42.42.2(pid=31081): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31081)] 05:48:55.080545 run osmo-hlr_10.42.42.2(pid=31081): stdout: | (launched: 2022-12-09_05:48:51.973665) 05:48:55.132706 run osmo-hlr_10.42.42.2(pid=31081): stderr: | 20221209054852175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054852175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054852175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054852176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054852176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054852176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054852187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054852195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054852196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054852196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:48:55.205592 run osmo-msc_10.42.42.6(pid=31087): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31087)] 05:48:55.256497 run osmo-msc_10.42.42.6(pid=31087): stdout: | (launched: 2022-12-09_05:48:54.045324) 05:48:55.308618 run osmo-msc_10.42.42.6(pid=31087): stderr: | 20221209054854368 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054854368 DLGLOBAL DEBUG validating counter group 0x7f1b23373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054854368 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054854369 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054854369 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054854369 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054854371 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054854371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054854371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054854371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:48:55.361276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31080): Terminating (SIGTERM) 05:48:55.403230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31083): Terminating (SIGTERM) 05:48:55.445457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31086): Terminating (SIGTERM) 05:48:55.487764 --- ParallelTerminationStrategy: PID 31080 died... 05:48:55.507447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31080): Terminated: ok {rc=0} 05:48:55.553759 --- ParallelTerminationStrategy: PID 31083 died... 05:48:55.573281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31083): Terminated: ok {rc=0} 05:48:55.619837 --- ParallelTerminationStrategy: PID 31086 died... 05:48:55.639331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31086): Terminated: ok {rc=0} 05:48:55.727464 bus /sierra_3: Setting Powered False 05:48:56.826678 bus /sierra_3: Setting Powered False 05:48:57.943007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:48:59.197520 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:48:59.204026 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:48:59.238598 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:48:59.267665 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:48:59.321305 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:48:59.355917 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:48:59.383258 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:48:59.933279 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:48:59.986533 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:48:59.998185 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:49:00.071712 tst mo_mt_call.py: using LAC 19359 05:49:00.194366 tst mo_mt_call.py: using RAC 234 05:49:00.317386 tst mo_mt_call.py: using CellId 19359 05:49:00.438286 tst mo_mt_call.py: using BVCI 19360 05:49:00.552427 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:00.563558 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:00.574308 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:00.585343 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:00.596303 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:00.607298 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:00.720371 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:00.846213 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:01.391366 run create_hlr_db(pid=31092): Launched 05:49:01.560835 bus /sierra_2: Setting Powered False 05:49:02.626167 run create_hlr_db(pid=31092): Terminated: ok {rc=0} 05:49:03.069462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Launched 05:49:03.379026 run osmo-hlr_10.42.42.2(pid=31095): Launched 05:49:03.495162 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:04.039133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Launched 05:49:04.346704 run osmo-stp_10.42.42.5(pid=31098): Launched 05:49:04.463298 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:05.018775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31100): Launched 05:49:05.326704 run osmo-msc_10.42.42.6(pid=31101): Launched 05:49:05.498794 run osmo-stp_10.42.42.5(pid=31098): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] 05:49:05.630007 run osmo-stp_10.42.42.5(pid=31098): stdout: | (launched: 2022-12-09_05:49:04.289797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:05.759897 run osmo-stp_10.42.42.5(pid=31098): stderr: | 20221209054904462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054904462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054904462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054904463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054904463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054904463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054904463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:05.888223 run osmo-stp_10.42.42.5(pid=31098): stdout: | (launched: 2022-12-09_05:49:04.289797) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:06.010275 run osmo-stp_10.42.42.5(pid=31098): stderr: | 20221209054904462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054904462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054904462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054904463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054904463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054904463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054904463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:06.156455 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31098): Process ended prematurely: osmo-stp_10.42.42.5(pid=31098) [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:49:06.165571 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:49:06.192573 run osmo-hlr_10.42.42.2(pid=31095): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31095)] 05:49:06.241370 run osmo-hlr_10.42.42.2(pid=31095): stdout: | (launched: 2022-12-09_05:49:03.322349) 05:49:06.291248 run osmo-hlr_10.42.42.2(pid=31095): stderr: | 20221209054903500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054903500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054903500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054903500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054903500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054903500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054903513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054903522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054903522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054903522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:06.361416 run osmo-msc_10.42.42.6(pid=31101): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31101)] 05:49:06.409705 run osmo-msc_10.42.42.6(pid=31101): stdout: | (launched: 2022-12-09_05:49:05.269567) 05:49:06.459671 run osmo-msc_10.42.42.6(pid=31101): stderr: | 20221209054905540 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054905541 DLGLOBAL DEBUG validating counter group 0x7f4505d97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054905541 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054905541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054905541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054905541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054905543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054905543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054905543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054905543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:06.509967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Terminating (SIGTERM) 05:49:06.550206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Terminating (SIGTERM) 05:49:06.590656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31100): Terminating (SIGTERM) 05:49:06.631506 --- ParallelTerminationStrategy: PID 31094 died... 05:49:06.650743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31094): Terminated: ok {rc=0} 05:49:06.696581 --- ParallelTerminationStrategy: PID 31097 died... 05:49:06.715579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31097): Terminated: ok {rc=0} 05:49:06.760623 --- ParallelTerminationStrategy: PID 31100 died... 05:49:06.779490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31100): Terminated: ok {rc=0} 05:49:06.865310 bus /sierra_3: Setting Powered False 05:49:07.964866 bus /sierra_3: Setting Powered False 05:49:09.084428 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:49:10.236374 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.248673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:49:10.321553 tst mo_mt_call_osmux.py: using LAC 19360 05:49:10.451953 tst mo_mt_call_osmux.py: using RAC 235 05:49:10.582538 tst mo_mt_call_osmux.py: using CellId 19360 05:49:10.706952 tst mo_mt_call_osmux.py: using BVCI 19361 05:49:10.820908 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.832144 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.843255 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.854963 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.866609 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:49:10.878743 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:10.999553 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:49:11.117081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:11.597362 run create_hlr_db(pid=31103): Launched 05:49:11.715155 bus /sierra_2: Setting Powered False 05:49:12.776657 run create_hlr_db(pid=31103): Terminated: ok {rc=0} 05:49:13.228058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Launched 05:49:13.558622 run osmo-hlr_10.42.42.2(pid=31106): Launched 05:49:13.686034 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:14.258441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Launched 05:49:14.590029 run osmo-stp_10.42.42.5(pid=31109): Launched 05:49:14.717617 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:15.314772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31111): Launched 05:49:15.645621 run osmo-msc_10.42.42.6(pid=31112): Launched 05:49:15.830665 run osmo-stp_10.42.42.5(pid=31109): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] 05:49:16.056784 run osmo-stp_10.42.42.5(pid=31109): stdout: | (launched: 2022-12-09_05:49:14.529042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:16.424554 run osmo-stp_10.42.42.5(pid=31109): stderr: | 20221209054914724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054914724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054914724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054914724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054914725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054914725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054914725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:16.573768 run osmo-stp_10.42.42.5(pid=31109): stdout: | (launched: 2022-12-09_05:49:14.529042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:16.703739 run osmo-stp_10.42.42.5(pid=31109): stderr: | 20221209054914724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054914724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054914724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054914724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054914725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054914725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054914725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:16.898338 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31109): Process ended prematurely: osmo-stp_10.42.42.5(pid=31109) [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:49:16.912501 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 05:49:16.943741 run osmo-hlr_10.42.42.2(pid=31106): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31106)] 05:49:16.996549 run osmo-hlr_10.42.42.2(pid=31106): stdout: | (launched: 2022-12-09_05:49:13.497982) 05:49:17.049903 run osmo-hlr_10.42.42.2(pid=31106): stderr: | 20221209054913697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054913697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054913697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054913697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054913697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054913697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054913710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054913719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054913719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054913719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:17.123640 run osmo-msc_10.42.42.6(pid=31112): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31112)] 05:49:17.174715 run osmo-msc_10.42.42.6(pid=31112): stdout: | (launched: 2022-12-09_05:49:15.584323) 05:49:17.229225 run osmo-msc_10.42.42.6(pid=31112): stderr: | 20221209054916015 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054916015 DLGLOBAL DEBUG validating counter group 0x7ff88201bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054916015 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054916015 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054916015 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054916015 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054916021 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054916022 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054916022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054916022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:17.283024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Terminating (SIGTERM) 05:49:17.326458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Terminating (SIGTERM) 05:49:17.371970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31111): Terminating (SIGTERM) 05:49:17.416005 --- ParallelTerminationStrategy: PID 31105 died... 05:49:17.435458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31105): Terminated: ok {rc=0} 05:49:17.481111 --- ParallelTerminationStrategy: PID 31108 died... 05:49:17.500209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31108): Terminated: ok {rc=0} 05:49:17.545316 --- ParallelTerminationStrategy: PID 31111 died... 05:49:17.564251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31111): Terminated: ok {rc=0} 05:49:17.651807 bus /sierra_3: Setting Powered False 05:49:18.753774 bus /sierra_3: Setting Powered False 05:49:19.870344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 05:49:21.130247 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:21.135709 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 05:49:21.169799 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 05:49:21.197042 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 05:49:21.252039 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 05:49:21.287739 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 05:49:21.314798 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 05:49:21.862222 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 05:49:21.914516 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:21.925893 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:49:21.975815 tst mo_mt_call.py: using LAC 19361 05:49:22.103579 tst mo_mt_call.py: using RAC 236 05:49:22.230846 tst mo_mt_call.py: using CellId 19361 05:49:22.360389 tst mo_mt_call.py: using BVCI 19362 05:49:22.479667 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:22.491228 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:22.502472 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:22.513724 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:22.525332 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:22.536556 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:22.651883 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:22.772009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:23.285546 run create_hlr_db(pid=31118): Launched 05:49:23.418360 bus /sierra_2: Setting Powered False 05:49:24.483328 run create_hlr_db(pid=31118): Terminated: ok {rc=0} 05:49:24.942986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Launched 05:49:25.272586 run osmo-hlr_10.42.42.2(pid=31121): Launched 05:49:25.397658 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:25.963332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Launched 05:49:26.292631 run osmo-stp_10.42.42.5(pid=31124): Launched 05:49:26.417849 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:27.017817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31126): Launched 05:49:27.347121 run osmo-msc_10.42.42.6(pid=31127): Launched 05:49:27.531681 run osmo-stp_10.42.42.5(pid=31124): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] 05:49:27.671976 run osmo-stp_10.42.42.5(pid=31124): stdout: | (launched: 2022-12-09_05:49:26.232000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:27.811278 run osmo-stp_10.42.42.5(pid=31124): stderr: | 20221209054926426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054926426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054926426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054926427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054926429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054926429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054926429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:27.949443 run osmo-stp_10.42.42.5(pid=31124): stdout: | (launched: 2022-12-09_05:49:26.232000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:28.080020 run osmo-stp_10.42.42.5(pid=31124): stderr: | 20221209054926426 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054926426 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054926426 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054926427 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054926429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054926429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054926429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:28.237188 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31124): Process ended prematurely: osmo-stp_10.42.42.5(pid=31124) [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 05:49:28.246769 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:49:28.274489 run osmo-hlr_10.42.42.2(pid=31121): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31121)] 05:49:28.325087 run osmo-hlr_10.42.42.2(pid=31121): stdout: | (launched: 2022-12-09_05:49:25.212172) 05:49:28.377506 run osmo-hlr_10.42.42.2(pid=31121): stderr: | 20221209054925413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054925413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054925413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054925413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054925413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054925414 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054925429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054925439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054925439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054925439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:28.450296 run osmo-msc_10.42.42.6(pid=31127): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31127)] 05:49:28.500862 run osmo-msc_10.42.42.6(pid=31127): stdout: | (launched: 2022-12-09_05:49:27.286117) 05:49:28.552913 run osmo-msc_10.42.42.6(pid=31127): stderr: | 20221209054927612 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054927612 DLGLOBAL DEBUG validating counter group 0x7fde767c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054927612 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054927612 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054927612 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054927613 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054927614 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054927615 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054927615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054927615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:28.605693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Terminating (SIGTERM) 05:49:28.648176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Terminating (SIGTERM) 05:49:28.690688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31126): Terminating (SIGTERM) 05:49:28.733118 --- ParallelTerminationStrategy: PID 31120 died... 05:49:28.753196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31120): Terminated: ok {rc=0} 05:49:28.799835 --- ParallelTerminationStrategy: PID 31123 died... 05:49:28.819449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31123): Terminated: ok {rc=0} 05:49:28.866328 --- ParallelTerminationStrategy: PID 31126 died... 05:49:28.886162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31126): Terminated: ok {rc=0} 05:49:28.974902 bus /sierra_3: Setting Powered False 05:49:30.073456 bus /sierra_3: Setting Powered False 05:49:31.189966 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 05:49:32.343717 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.355768 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 05:49:32.408241 tst mo_mt_call_osmux.py: using LAC 19362 05:49:32.537212 tst mo_mt_call_osmux.py: using RAC 237 05:49:32.667062 tst mo_mt_call_osmux.py: using CellId 19362 05:49:32.788157 tst mo_mt_call_osmux.py: using BVCI 19363 05:49:32.910222 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.921820 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.933149 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.944508 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.955819 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 05:49:32.967146 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:33.083964 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 05:49:33.204289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:33.719110 run create_hlr_db(pid=31129): Launched 05:49:33.853277 bus /sierra_2: Setting Powered False 05:49:34.918230 run create_hlr_db(pid=31129): Terminated: ok {rc=0} 05:49:35.358119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31131): Launched 05:49:35.666710 run osmo-hlr_10.42.42.2(pid=31132): Launched 05:49:35.783917 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:36.337270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31134): Launched 05:49:36.668701 run osmo-stp_10.42.42.5(pid=31135): Launched 05:49:36.793430 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:37.388328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31137): Launched 05:49:37.719368 run osmo-msc_10.42.42.6(pid=31138): Launched 05:49:37.901444 run osmo-stp_10.42.42.5(pid=31135): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31135)] 05:49:38.041204 run osmo-stp_10.42.42.5(pid=31135): stdout: | (launched: 2022-12-09_05:49:36.607240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:38.180141 run osmo-stp_10.42.42.5(pid=31135): stderr: | 20221209054936802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054936803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054936803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054936803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054936804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054936804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054936804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:38.322881 run osmo-stp_10.42.42.5(pid=31135): stdout: | (launched: 2022-12-09_05:49:36.607240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:38.453241 run osmo-stp_10.42.42.5(pid=31135): stderr: | 20221209054936802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054936803 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054936803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054936803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054936804 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054936804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054936804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:38.610471 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31135): Process ended prematurely: osmo-stp_10.42.42.5(pid=31135) [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31135)] [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 05:49:38.620077 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 05:49:38.648405 run osmo-hlr_10.42.42.2(pid=31132): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31132)] 05:49:38.698897 run osmo-hlr_10.42.42.2(pid=31132): stdout: | (launched: 2022-12-09_05:49:35.609670) 05:49:38.751534 run osmo-hlr_10.42.42.2(pid=31132): stderr: | 20221209054935788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054935788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054935788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054935788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054935788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054935788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054935801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054935810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054935810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054935810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:38.823957 run osmo-msc_10.42.42.6(pid=31138): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31138)] 05:49:38.874313 run osmo-msc_10.42.42.6(pid=31138): stdout: | (launched: 2022-12-09_05:49:37.658450) 05:49:38.926313 run osmo-msc_10.42.42.6(pid=31138): stderr: | 20221209054937984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054937984 DLGLOBAL DEBUG validating counter group 0x7f0c20186c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054937984 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054937985 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054937985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054937985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054937987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054937987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054937987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054937987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:38.978595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31131): Terminating (SIGTERM) 05:49:39.020289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31134): Terminating (SIGTERM) 05:49:39.062295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31137): Terminating (SIGTERM) 05:49:39.104287 --- ParallelTerminationStrategy: PID 31131 died... 05:49:39.123990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31131): Terminated: ok {rc=0} 05:49:39.170194 --- ParallelTerminationStrategy: PID 31134 died... 05:49:39.189736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31134): Terminated: ok {rc=0} 05:49:39.235719 --- ParallelTerminationStrategy: PID 31137 died... 05:49:39.255236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31137): Terminated: ok {rc=0} 05:49:39.343448 bus /sierra_3: Setting Powered False 05:49:40.441863 bus /sierra_3: Setting Powered False 05:49:41.558404 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:49:42.811488 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:49:42.818080 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:49:42.852184 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 05:49:42.879732 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 05:49:42.932660 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:49:42.966545 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 05:49:42.993992 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 05:49:43.548421 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 05:49:43.602352 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:43.614218 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:49:43.671849 tst mo_mt_call.py: using LAC 19363 05:49:43.801734 tst mo_mt_call.py: using RAC 238 05:49:43.929414 tst mo_mt_call.py: using CellId 19363 05:49:44.057401 tst mo_mt_call.py: using BVCI 19364 05:49:44.177306 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:44.189068 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:44.200906 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:44.212558 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:44.224208 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:44.235807 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:44.354058 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:44.473614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:44.953712 run create_hlr_db(pid=31143): Launched 05:49:45.073775 bus /sierra_2: Setting Powered False 05:49:46.140569 run create_hlr_db(pid=31143): Terminated: ok {rc=0} 05:49:46.621608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31145): Launched 05:49:46.966910 run osmo-hlr_10.42.42.2(pid=31146): Launched 05:49:47.155690 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:47.687123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31148): Launched 05:49:47.996928 run osmo-stp_10.42.42.5(pid=31149): Launched 05:49:48.114580 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:48.673054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31151): Launched 05:49:48.981711 run osmo-msc_10.42.42.6(pid=31152): Launched 05:49:49.154103 run osmo-stp_10.42.42.5(pid=31149): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31149)] 05:49:49.286450 run osmo-stp_10.42.42.5(pid=31149): stdout: | (launched: 2022-12-09_05:49:47.939587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:49.417151 run osmo-stp_10.42.42.5(pid=31149): stderr: | 20221209054948111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054948111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054948112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054948112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054948112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054948112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054948113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:49.545821 run osmo-stp_10.42.42.5(pid=31149): stdout: | (launched: 2022-12-09_05:49:47.939587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:49.668865 run osmo-stp_10.42.42.5(pid=31149): stderr: | 20221209054948111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054948111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054948112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054948112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054948112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054948112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054948113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:49.815949 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31149): Process ended prematurely: osmo-stp_10.42.42.5(pid=31149) [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31149)] [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 05:49:49.824921 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 05:49:49.851827 run osmo-hlr_10.42.42.2(pid=31146): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31146)] 05:49:49.900243 run osmo-hlr_10.42.42.2(pid=31146): stdout: | (launched: 2022-12-09_05:49:46.900297) 05:49:49.950569 run osmo-hlr_10.42.42.2(pid=31146): stderr: | 20221209054947168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054947168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054947168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054947168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054947168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054947168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054947180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054947190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054947190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054947190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:49:50.020553 run osmo-msc_10.42.42.6(pid=31152): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31152)] 05:49:50.069258 run osmo-msc_10.42.42.6(pid=31152): stdout: | (launched: 2022-12-09_05:49:48.924337) 05:49:50.119630 run osmo-msc_10.42.42.6(pid=31152): stderr: | 20221209054949198 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054949198 DLGLOBAL DEBUG validating counter group 0x7f97e19efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054949198 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054949198 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054949198 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054949198 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054949200 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054949201 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054949201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054949201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:49:50.170506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31145): Terminating (SIGTERM) 05:49:50.211092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31148): Terminating (SIGTERM) 05:49:50.251602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31151): Terminating (SIGTERM) 05:49:50.292231 --- ParallelTerminationStrategy: PID 31145 died... 05:49:50.311592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31145): Terminated: ok {rc=0} 05:49:50.356453 --- ParallelTerminationStrategy: PID 31148 died... 05:49:50.375213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31148): Terminated: ok {rc=0} 05:49:50.419773 --- ParallelTerminationStrategy: PID 31151 died... 05:49:50.438449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31151): Terminated: ok {rc=0} 05:49:50.523765 bus /sierra_3: Setting Powered False 05:49:51.623495 bus /sierra_3: Setting Powered False 05:49:52.742559 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 05:49:53.887914 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:53.900044 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:49:53.953233 tst mo_mt_call_osmux.py: using LAC 19364 05:49:54.075388 tst mo_mt_call_osmux.py: using RAC 239 05:49:54.197685 tst mo_mt_call_osmux.py: using CellId 19364 05:49:54.329143 tst mo_mt_call_osmux.py: using BVCI 19365 05:49:54.449679 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:54.461679 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:54.473593 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:54.485207 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:54.497078 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 05:49:54.508849 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:54.630533 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 05:49:54.754175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:49:55.233236 run create_hlr_db(pid=31154): Launched 05:49:55.351815 bus /sierra_2: Setting Powered False 05:49:56.412562 run create_hlr_db(pid=31154): Terminated: ok {rc=0} 05:49:56.841958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31156): Launched 05:49:57.149668 run osmo-hlr_10.42.42.2(pid=31157): Launched 05:49:57.267768 run osmo-stp_10.42.42.5: Starting osmo-stp 05:49:57.802148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31159): Launched 05:49:58.110733 run osmo-stp_10.42.42.5(pid=31160): Launched 05:49:58.228595 run osmo-msc_10.42.42.6: Starting osmo-msc 05:49:58.783946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31162): Launched 05:49:59.091037 run osmo-msc_10.42.42.6(pid=31163): Launched 05:49:59.262266 run osmo-stp_10.42.42.5(pid=31160): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31160)] 05:49:59.393175 run osmo-stp_10.42.42.5(pid=31160): stdout: | (launched: 2022-12-09_05:49:58.052836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:59.522549 run osmo-stp_10.42.42.5(pid=31160): stderr: | 20221209054958226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054958226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054958226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054958226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054958227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054958227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054958227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:59.650349 run osmo-stp_10.42.42.5(pid=31160): stdout: | (launched: 2022-12-09_05:49:58.052836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:49:59.772041 run osmo-stp_10.42.42.5(pid=31160): stderr: | 20221209054958226 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209054958226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209054958226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209054958226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209054958227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209054958227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209054958227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:49:59.917572 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31160): Process ended prematurely: osmo-stp_10.42.42.5(pid=31160) [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31160)] [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 05:49:59.926500 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 05:49:59.953165 run osmo-hlr_10.42.42.2(pid=31157): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31157)] 05:50:00.001485 run osmo-hlr_10.42.42.2(pid=31157): stdout: | (launched: 2022-12-09_05:49:57.092600) 05:50:00.051364 run osmo-hlr_10.42.42.2(pid=31157): stderr: | 20221209054957271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209054957271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209054957271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209054957271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209054957271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209054957271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209054957283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209054957292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209054957292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209054957292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:00.120843 run osmo-msc_10.42.42.6(pid=31163): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31163)] 05:50:00.168828 run osmo-msc_10.42.42.6(pid=31163): stdout: | (launched: 2022-12-09_05:49:59.034166) 05:50:00.218460 run osmo-msc_10.42.42.6(pid=31163): stderr: | 20221209054959307 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209054959308 DLGLOBAL DEBUG validating counter group 0x7f8cd095ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209054959308 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209054959308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209054959308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209054959308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209054959310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209054959310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209054959311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209054959311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:00.268758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31156): Terminating (SIGTERM) 05:50:00.309107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31159): Terminating (SIGTERM) 05:50:00.349606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31162): Terminating (SIGTERM) 05:50:00.390242 --- ParallelTerminationStrategy: PID 31156 died... 05:50:00.409589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31156): Terminated: ok {rc=0} 05:50:00.454102 --- ParallelTerminationStrategy: PID 31159 died... 05:50:00.473899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31159): Terminated: ok {rc=0} 05:50:00.518577 --- ParallelTerminationStrategy: PID 31162 died... 05:50:00.537236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31162): Terminated: ok {rc=0} 05:50:00.623939 bus /sierra_3: Setting Powered False 05:50:01.729225 bus /sierra_3: Setting Powered False 05:50:02.855265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:trx-b200 --------------------------------------------------------------------- 05:50:04.101912 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:04.106247 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 05:50:04.139613 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 05:50:04.166569 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 05:50:04.250457 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 05:50:04.283591 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 05:50:04.310604 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 05:50:04.893124 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 05:50:04.898072 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:04.908701 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:50:04.957381 tst emergency_mo_mt_call.py: using LAC 19365 05:50:05.076093 tst emergency_mo_mt_call.py: using RAC 240 05:50:05.199061 tst emergency_mo_mt_call.py: using CellId 19365 05:50:05.317226 tst emergency_mo_mt_call.py: using BVCI 19366 05:50:05.426639 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:05.437449 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:05.447921 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:05.458693 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:05.469620 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:05.480249 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:05.598407 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:05.718057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:06.221019 run create_hlr_db(pid=31171): Launched 05:50:06.352914 bus /sierra_2: Setting Powered False 05:50:07.416695 run create_hlr_db(pid=31171): Terminated: ok {rc=0} 05:50:07.851765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Launched 05:50:08.155456 run osmo-hlr_10.42.42.2(pid=31174): Launched 05:50:08.270130 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:08.792849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Launched 05:50:09.120041 run osmo-stp_10.42.42.5(pid=31177): Launched 05:50:09.256167 tst emergency_mo_mt_call.py: using MSISDN 7051 05:50:09.423576 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:10.009493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Launched 05:50:10.334027 run osmo-msc_10.42.42.6(pid=31180): Launched 05:50:10.513472 run osmo-stp_10.42.42.5(pid=31177): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] 05:50:10.650004 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-09_05:50:09.059601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:10.786338 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221209055009255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055009255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055009255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055009256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055009256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055009256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055009257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:10.922170 run osmo-stp_10.42.42.5(pid=31177): stdout: | (launched: 2022-12-09_05:50:09.059601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:11.050559 run osmo-stp_10.42.42.5(pid=31177): stderr: | 20221209055009255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055009255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055009255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055009256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055009256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055009256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055009257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:11.204333 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 05:50:11.213578 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 05:50:11.241408 run osmo-hlr_10.42.42.2(pid=31174): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31174)] 05:50:11.291846 run osmo-hlr_10.42.42.2(pid=31174): stdout: | (launched: 2022-12-09_05:50:08.099270) 05:50:11.344171 run osmo-hlr_10.42.42.2(pid=31174): stderr: | 20221209055008278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055008278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055008278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055008278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055008278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055008278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055008289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055008298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055008298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055008299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:11.417272 run osmo-msc_10.42.42.6(pid=31180): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31180)] 05:50:11.467351 run osmo-msc_10.42.42.6(pid=31180): stdout: | (launched: 2022-12-09_05:50:10.274352) 05:50:11.519120 run osmo-msc_10.42.42.6(pid=31180): stderr: | 20221209055010601 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055010601 DLGLOBAL DEBUG validating counter group 0x7ff73aa04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055010601 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055010601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055010602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055010602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055010603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055010604 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055010604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055010604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:11.571213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminating (SIGTERM) 05:50:11.613172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminating (SIGTERM) 05:50:11.655934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Terminating (SIGTERM) 05:50:11.698285 --- ParallelTerminationStrategy: PID 31173 died... 05:50:11.718428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31173): Terminated: ok {rc=0} 05:50:11.765329 --- ParallelTerminationStrategy: PID 31176 died... 05:50:11.785048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31176): Terminated: ok {rc=0} 05:50:11.831546 --- ParallelTerminationStrategy: PID 31179 died... 05:50:11.851294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31179): Terminated: ok {rc=0} 05:50:11.939896 bus /sierra_3: Setting Powered False 05:50:13.041505 bus /sierra_3: Setting Powered False 05:50:14.161358 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 05:50:15.249112 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.260586 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 05:50:15.311571 tst emergency_preemptive_call.py: using LAC 19366 05:50:15.431543 tst emergency_preemptive_call.py: using RAC 241 05:50:15.555517 tst emergency_preemptive_call.py: using CellId 19366 05:50:15.673117 tst emergency_preemptive_call.py: using BVCI 19367 05:50:15.782471 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.793308 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.803844 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.814645 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.825515 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 05:50:15.851750 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:15.978642 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:16.103320 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:16.230730 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 05:50:16.361293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:16.889741 run create_hlr_db(pid=31182): Launched 05:50:17.055852 bus /sierra_2: Setting Powered False 05:50:18.120717 run create_hlr_db(pid=31182): Terminated: ok {rc=0} 05:50:18.557629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Launched 05:50:18.861480 run osmo-hlr_10.42.42.2(pid=31185): Launched 05:50:18.976508 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:19.501250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Launched 05:50:19.804164 run osmo-stp_10.42.42.5(pid=31188): Launched 05:50:19.930169 tst emergency_preemptive_call.py: using MSISDN 7052 05:50:20.084537 run osmo-msc_10.42.42.6: Starting osmo-msc 05:50:20.627100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31190): Launched 05:50:20.930376 run osmo-msc_10.42.42.6(pid=31191): Launched 05:50:21.099813 run osmo-stp_10.42.42.5(pid=31188): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] 05:50:21.228362 run osmo-stp_10.42.42.5(pid=31188): stdout: | (launched: 2022-12-09_05:50:19.748042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:21.357138 run osmo-stp_10.42.42.5(pid=31188): stderr: | 20221209055019917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055019917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055019918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055019918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055019920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055019920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055019920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:21.483003 run osmo-stp_10.42.42.5(pid=31188): stdout: | (launched: 2022-12-09_05:50:19.748042) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:21.603229 run osmo-stp_10.42.42.5(pid=31188): stderr: | 20221209055019917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055019917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055019918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055019918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055019920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055019920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055019920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:21.747026 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31188): Process ended prematurely: osmo-stp_10.42.42.5(pid=31188) [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py:32] 05:50:21.755325 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 05:50:21.782406 run osmo-hlr_10.42.42.2(pid=31185): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31185)] 05:50:21.831210 run osmo-hlr_10.42.42.2(pid=31185): stdout: | (launched: 2022-12-09_05:50:18.805296) 05:50:21.881928 run osmo-hlr_10.42.42.2(pid=31185): stderr: | 20221209055018984 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055018984 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055018984 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055018985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055018985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055018985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055018996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055019005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055019006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055019006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:21.952933 run osmo-msc_10.42.42.6(pid=31191): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31191)] 05:50:22.001711 run osmo-msc_10.42.42.6(pid=31191): stdout: | (launched: 2022-12-09_05:50:20.874118) 05:50:22.052207 run osmo-msc_10.42.42.6(pid=31191): stderr: | 20221209055021147 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055021147 DLGLOBAL DEBUG validating counter group 0x7f7d4ee0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055021148 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055021148 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055021148 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055021148 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055021150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055021150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055021151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055021151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:50:22.102792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Terminating (SIGTERM) 05:50:22.143280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Terminating (SIGTERM) 05:50:22.183919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31190): Terminating (SIGTERM) 05:50:22.224736 --- ParallelTerminationStrategy: PID 31184 died... 05:50:22.244012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Terminated: ok {rc=0} 05:50:22.289523 --- ParallelTerminationStrategy: PID 31187 died... 05:50:22.308358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Terminated: ok {rc=0} 05:50:22.353501 --- ParallelTerminationStrategy: PID 31190 died... 05:50:22.372327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31190): Terminated: ok {rc=0} 05:50:22.459760 bus /sierra_9: Setting Powered False 05:50:23.561530 bus /sierra_9: Setting Powered False 05:50:24.679450 bus /sierra_8: Setting Powered False 05:50:25.780311 bus /sierra_8: Setting Powered False 05:50:26.897925 bus /sierra_3: Setting Powered False 05:50:27.995501 bus /sierra_3: Setting Powered False 05:50:29.113024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-b200 --------------------------------------------------------------------- 05:50:30.400051 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:50:30.404780 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 05:50:30.438662 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 05:50:30.477839 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 05:50:30.566396 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 05:50:30.600328 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 05:50:30.639786 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 05:50:31.260930 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 05:50:31.318461 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:31.330453 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:31.382187 tst cs_paging_gprs_active.py: using LAC 19367 05:50:31.548213 tst cs_paging_gprs_active.py: using RAC 242 05:50:31.709245 tst cs_paging_gprs_active.py: using CellId 19367 05:50:31.866288 tst cs_paging_gprs_active.py: using BVCI 19368 05:50:32.028152 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.040345 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.052281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.063793 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.075204 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.086706 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.098680 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.110605 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:32.122220 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:32.249723 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:32.372505 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:50:32.595200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:32.927300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Launched 05:50:33.215194 run iperf3-srv_10.42.42.10(pid=31197): Launched 05:50:33.338985 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:50:33.560787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:33.892350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Launched 05:50:34.179819 run iperf3-srv_10.42.42.10(pid=31199): Launched 05:50:34.303623 tst cs_paging_gprs_active.py:38: start network... 05:50:34.525822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:35.039123 run create_hlr_db(pid=31200): Launched 05:50:35.173559 bus /sierra_2: Setting Powered False 05:50:36.239090 run create_hlr_db(pid=31200): Terminated: ok {rc=0} 05:50:36.698225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31202): Launched 05:50:37.028491 run osmo-hlr_10.42.42.2(pid=31203): Launched 05:50:37.153835 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:37.724083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31205): Launched 05:50:38.053866 run osmo-stp_10.42.42.5(pid=31206): Launched 05:50:38.179309 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:38.751640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31208): Launched 05:50:38.877950 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:39.158673 run patchelf(pid=31209): Launched 05:50:39.342937 run osmo-stp_10.42.42.5(pid=31206): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31206)] 05:50:39.483593 run osmo-stp_10.42.42.5(pid=31206): stdout: | (launched: 2022-12-09_05:50:37.992907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:39.625136 run osmo-stp_10.42.42.5(pid=31206): stderr: | 20221209055038186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055038186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055038187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055038187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055038187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055038188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055038188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:39.767496 run osmo-stp_10.42.42.5(pid=31206): stdout: | (launched: 2022-12-09_05:50:37.992907) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:39.903276 run osmo-stp_10.42.42.5(pid=31206): stderr: | 20221209055038186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055038186 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055038187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055038187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055038187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055038188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055038188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:40.065279 run patchelf(pid=31209): Terminating (SIGINT) 05:50:40.250534 run patchelf(pid=31209): Terminated: ok {rc=0} 05:50:40.384004 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31206): Process ended prematurely: osmo-stp_10.42.42.5(pid=31206) [trial-2355↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31206)] [trial-2355↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 05:50:40.394208 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 05:50:40.422897 run osmo-hlr_10.42.42.2(pid=31203): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31203)] 05:50:40.473822 run osmo-hlr_10.42.42.2(pid=31203): stdout: | (launched: 2022-12-09_05:50:36.967861) 05:50:40.525887 run osmo-hlr_10.42.42.2(pid=31203): stderr: | 20221209055037169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055037169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055037169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055037169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055037169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055037169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055037181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055037190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055037191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055037191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:40.578230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Terminating (SIGTERM) 05:50:40.620183 run iperf3-srv_10.42.42.10(pid=31197): Terminating (SIGTERM) 05:50:40.662580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Terminating (SIGTERM) 05:50:40.704991 run iperf3-srv_10.42.42.10(pid=31199): Terminating (SIGTERM) 05:50:40.747090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31202): Terminating (SIGTERM) 05:50:40.789138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31205): Terminating (SIGTERM) 05:50:40.831355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31208): Terminating (SIGTERM) 05:50:40.874065 --- ParallelTerminationStrategy: PID 31196 died... 05:50:40.894345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Terminated: ok {rc=0} 05:50:40.941108 --- ParallelTerminationStrategy: PID 31197 died... 05:50:40.960750 run iperf3-srv_10.42.42.10(pid=31197): Terminated {rc=256} 05:50:41.007053 --- ParallelTerminationStrategy: PID 31198 died... 05:50:41.026677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Terminated: ok {rc=0} 05:50:41.073107 --- ParallelTerminationStrategy: PID 31199 died... 05:50:41.092664 run iperf3-srv_10.42.42.10(pid=31199): Terminated {rc=256} 05:50:41.138996 --- ParallelTerminationStrategy: PID 31202 died... 05:50:41.159109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31202): Terminated: ok {rc=0} 05:50:41.205283 --- ParallelTerminationStrategy: PID 31205 died... 05:50:41.224874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31205): Terminated: ok {rc=0} 05:50:41.271401 --- ParallelTerminationStrategy: PID 31208 died... 05:50:41.291128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31208): Terminated: ok {rc=0} 05:50:41.379460 bus /gobi_0: Setting Powered False 05:50:42.480463 bus /gobi_0: Setting Powered False 05:50:43.598367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200 iperf3.py ---------------------------------------------- 05:50:44.751852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:44.763751 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:44.816831 tst iperf3.py: using LAC 19368 05:50:44.946613 tst iperf3.py: using RAC 243 05:50:45.075828 tst iperf3.py: using CellId 19368 05:50:45.199462 tst iperf3.py: using BVCI 19369 05:50:45.314431 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.325420 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.335961 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.347035 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.357901 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.368712 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.379931 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.390339 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:45.401659 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:45.519970 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:50:45.737106 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:46.086353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31210): Launched 05:50:46.404140 run iperf3-srv_10.42.42.10(pid=31211): Launched 05:50:46.536628 tst iperf3.py:8: start network... 05:50:46.747137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:47.237585 run create_hlr_db(pid=31212): Launched 05:50:47.371754 bus /gobi_6: Setting Powered False 05:50:48.435902 run create_hlr_db(pid=31212): Terminated: ok {rc=0} 05:50:48.894432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31214): Launched 05:50:49.223468 run osmo-hlr_10.42.42.2(pid=31215): Launched 05:50:49.348254 run osmo-stp_10.42.42.5: Starting osmo-stp 05:50:49.921357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31217): Launched 05:50:50.253618 run osmo-stp_10.42.42.5(pid=31218): Launched 05:50:50.378990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:50:50.948799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31220): Launched 05:50:51.074905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:50:51.354873 run patchelf(pid=31221): Launched 05:50:51.539010 run osmo-stp_10.42.42.5(pid=31218): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31218)] 05:50:51.679858 run osmo-stp_10.42.42.5(pid=31218): stdout: | (launched: 2022-12-09_05:50:50.192465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:51.820863 run osmo-stp_10.42.42.5(pid=31218): stderr: | 20221209055050387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055050387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055050388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055050388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055050388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055050389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055050389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:51.962456 run osmo-stp_10.42.42.5(pid=31218): stdout: | (launched: 2022-12-09_05:50:50.192465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:50:52.099213 run osmo-stp_10.42.42.5(pid=31218): stderr: | 20221209055050387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055050387 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055050388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055050388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055050388 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055050389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055050389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:50:52.261373 run patchelf(pid=31221): Terminating (SIGINT) 05:50:52.446676 run patchelf(pid=31221): Terminated: ok {rc=0} 05:50:52.580294 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31218): Process ended prematurely: osmo-stp_10.42.42.5(pid=31218) [trial-2355↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31218)] [trial-2355↪gprs:trx-b200↪iperf3.py:8] 05:50:52.590690 tst iperf3.py:8: Test FAILED (7.9 sec) 05:50:52.619541 run osmo-hlr_10.42.42.2(pid=31215): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31215)] 05:50:52.670610 run osmo-hlr_10.42.42.2(pid=31215): stdout: | (launched: 2022-12-09_05:50:49.163090) 05:50:52.723346 run osmo-hlr_10.42.42.2(pid=31215): stderr: | 20221209055049364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055049364 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055049364 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055049364 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055049364 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055049364 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055049377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055049385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055049385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055049385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:50:52.776368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31210): Terminating (SIGTERM) 05:50:52.819149 run iperf3-srv_10.42.42.10(pid=31211): Terminating (SIGTERM) 05:50:52.861545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31214): Terminating (SIGTERM) 05:50:52.904245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31217): Terminating (SIGTERM) 05:50:52.946991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31220): Terminating (SIGTERM) 05:50:52.989918 --- ParallelTerminationStrategy: PID 31210 died... 05:50:53.010312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31210): Terminated: ok {rc=0} 05:50:53.057310 --- ParallelTerminationStrategy: PID 31211 died... 05:50:53.077263 run iperf3-srv_10.42.42.10(pid=31211): Terminated {rc=256} 05:50:53.124122 --- ParallelTerminationStrategy: PID 31214 died... 05:50:53.143938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31214): Terminated: ok {rc=0} 05:50:53.190803 --- ParallelTerminationStrategy: PID 31217 died... 05:50:53.210786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31217): Terminated: ok {rc=0} 05:50:53.257628 --- ParallelTerminationStrategy: PID 31220 died... 05:50:53.277604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31220): Terminated: ok {rc=0} 05:50:53.367041 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 05:50:54.519425 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:54.531182 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:50:54.586452 tst iperf3m4.py: using LAC 19369 05:50:54.714882 tst iperf3m4.py: using RAC 244 05:50:54.844198 tst iperf3m4.py: using CellId 19369 05:50:54.973509 tst iperf3m4.py: using BVCI 19370 05:50:55.093890 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.105086 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.116077 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.127002 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.137861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.148555 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.159698 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.170677 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:50:55.181709 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:55.299644 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:55.419336 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:55.539948 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:50:55.656574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:50:55.865501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:56.175296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31222): Launched 05:50:56.445675 run iperf3-srv_10.42.42.10(pid=31223): Launched 05:50:56.562146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:50:56.768223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:57.078574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Launched 05:50:57.347653 run iperf3-srv_10.42.42.10(pid=31225): Launched 05:50:57.463120 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:50:57.669655 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:57.978868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Launched 05:50:58.248494 run iperf3-srv_10.42.42.10(pid=31227): Launched 05:50:58.364240 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:50:58.570020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:50:58.879861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31228): Launched 05:50:59.148718 run iperf3-srv_10.42.42.10(pid=31229): Launched 05:50:59.264658 tst iperf3m4.py:8: start network... 05:50:59.470834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:50:59.949224 run create_hlr_db(pid=31230): Launched 05:51:00.068455 bus /gobi_6: Setting Powered False 05:51:01.148794 run create_hlr_db(pid=31230): Terminated: ok {rc=0} 05:51:01.658568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Launched 05:51:02.010875 run osmo-hlr_10.42.42.2(pid=31233): Launched 05:51:02.208301 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:02.741269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Launched 05:51:03.050863 run osmo-stp_10.42.42.5(pid=31236): Launched 05:51:03.167877 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:03.699123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Launched 05:51:03.817373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:04.079152 run patchelf(pid=31239): Launched 05:51:04.251509 run osmo-stp_10.42.42.5(pid=31236): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] 05:51:04.383374 run osmo-stp_10.42.42.5(pid=31236): stdout: | (launched: 2022-12-09_05:51:02.993662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:04.516270 run osmo-stp_10.42.42.5(pid=31236): stderr: | 20221209055103164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055103165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055103165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055103165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055103166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055103166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055103166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:04.649154 run osmo-stp_10.42.42.5(pid=31236): stdout: | (launched: 2022-12-09_05:51:02.993662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:04.777257 run osmo-stp_10.42.42.5(pid=31236): stderr: | 20221209055103164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055103165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055103165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055103165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055103166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055103166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055103166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:04.928723 run patchelf(pid=31239): Terminating (SIGINT) 05:51:05.102780 run patchelf(pid=31239): Terminated: ok {rc=0} 05:51:05.227930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31236): Process ended prematurely: osmo-stp_10.42.42.5(pid=31236) [trial-2355↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] [trial-2355↪gprs:trx-b200↪iperf3m4.py:8] 05:51:05.237553 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:51:05.265691 run osmo-hlr_10.42.42.2(pid=31233): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31233)] 05:51:05.314642 run osmo-hlr_10.42.42.2(pid=31233): stdout: | (launched: 2022-12-09_05:51:01.943545) 05:51:05.365194 run osmo-hlr_10.42.42.2(pid=31233): stderr: | 20221209055102208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055102208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055102208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055102208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055102208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055102208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055102220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055102228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055102228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055102228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:05.416043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31222): Terminating (SIGTERM) 05:51:05.457062 run iperf3-srv_10.42.42.10(pid=31223): Terminating (SIGTERM) 05:51:05.497906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Terminating (SIGTERM) 05:51:05.538872 run iperf3-srv_10.42.42.10(pid=31225): Terminating (SIGTERM) 05:51:05.579824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminating (SIGTERM) 05:51:05.620776 run iperf3-srv_10.42.42.10(pid=31227): Terminating (SIGTERM) 05:51:05.661685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31228): Terminating (SIGTERM) 05:51:05.702520 run iperf3-srv_10.42.42.10(pid=31229): Terminating (SIGTERM) 05:51:05.743130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Terminating (SIGTERM) 05:51:05.783887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Terminating (SIGTERM) 05:51:05.824596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Terminating (SIGTERM) 05:51:05.865667 --- ParallelTerminationStrategy: PID 31222 died... 05:51:05.884556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31222): Terminated: ok {rc=0} 05:51:05.930402 --- ParallelTerminationStrategy: PID 31223 died... 05:51:05.949361 run iperf3-srv_10.42.42.10(pid=31223): Terminated {rc=256} 05:51:05.994323 --- ParallelTerminationStrategy: PID 31224 died... 05:51:06.013244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31224): Terminated: ok {rc=0} 05:51:06.058793 --- ParallelTerminationStrategy: PID 31225 died... 05:51:06.077774 run iperf3-srv_10.42.42.10(pid=31225): Terminated {rc=256} 05:51:06.122511 --- ParallelTerminationStrategy: PID 31226 died... 05:51:06.141206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31226): Terminated: ok {rc=0} 05:51:06.185797 --- ParallelTerminationStrategy: PID 31227 died... 05:51:06.204404 run iperf3-srv_10.42.42.10(pid=31227): Terminated {rc=256} 05:51:06.248626 --- ParallelTerminationStrategy: PID 31228 died... 05:51:06.267572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31228): Terminated: ok {rc=0} 05:51:06.312710 --- ParallelTerminationStrategy: PID 31229 died... 05:51:06.331483 run iperf3-srv_10.42.42.10(pid=31229): Terminated {rc=256} 05:51:06.376075 --- ParallelTerminationStrategy: PID 31232 died... 05:51:06.394996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31232): Terminated: ok {rc=0} 05:51:06.439330 --- ParallelTerminationStrategy: PID 31235 died... 05:51:06.458283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31235): Terminated: ok {rc=0} 05:51:06.502842 --- ParallelTerminationStrategy: PID 31238 died... 05:51:06.521608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31238): Terminated: ok {rc=0} 05:51:06.608367 bus /gobi_4: Setting Powered False 05:51:07.709229 bus /gobi_4: Setting Powered False 05:51:08.825278 bus /gobi_1: Setting Powered False 05:51:09.925871 bus /gobi_1: Setting Powered False 05:51:11.043073 bus /gobi_0: Setting Powered False 05:51:12.142631 bus /gobi_0: Setting Powered False 05:51:13.259153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200 ping.py ---------------------------------------------- 05:51:14.363644 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.375426 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:14.425170 tst ping.py: using LAC 19370 05:51:14.547750 tst ping.py: using RAC 245 05:51:14.664050 tst ping.py: using CellId 19370 05:51:14.781302 tst ping.py: using BVCI 19371 05:51:14.890707 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.901320 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.911814 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.922543 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.933215 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.943780 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.954652 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:14.965401 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:15.078986 tst ping.py:19: start network... 05:51:15.282310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:15.749970 run create_hlr_db(pid=31240): Launched 05:51:15.873645 bus /gobi_6: Setting Powered False 05:51:16.936125 run create_hlr_db(pid=31240): Terminated: ok {rc=0} 05:51:17.410985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Launched 05:51:17.736552 run osmo-hlr_10.42.42.2(pid=31243): Launched 05:51:17.859376 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:18.424176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Launched 05:51:18.749925 run osmo-stp_10.42.42.5(pid=31246): Launched 05:51:18.872826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:19.432524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Launched 05:51:19.556835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:19.831927 run patchelf(pid=31249): Launched 05:51:20.012854 run osmo-stp_10.42.42.5(pid=31246): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] 05:51:20.150724 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-09_05:51:18.690135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:20.290424 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221209055118885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055118885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055118885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055118886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055118886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055118886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055118886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:20.430282 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-09_05:51:18.690135) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:20.563683 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221209055118885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055118885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055118885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055118886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055118886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055118886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055118886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:20.722130 run patchelf(pid=31249): Terminating (SIGINT) 05:51:20.904604 run patchelf(pid=31249): Terminated: ok {rc=0} 05:51:21.035765 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2355↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] [trial-2355↪gprs:trx-b200↪ping.py:22] 05:51:21.045255 tst ping.py:22: Test FAILED (6.7 sec) 05:51:21.073345 run osmo-hlr_10.42.42.2(pid=31243): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31243)] 05:51:21.123877 run osmo-hlr_10.42.42.2(pid=31243): stdout: | (launched: 2022-12-09_05:51:17.677071) 05:51:21.176072 run osmo-hlr_10.42.42.2(pid=31243): stderr: | 20221209055117876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055117876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055117877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055117877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055117877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055117877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055117889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055117897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055117897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055117897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:21.228584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminating (SIGTERM) 05:51:21.271079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminating (SIGTERM) 05:51:21.313526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminating (SIGTERM) 05:51:21.356126 --- ParallelTerminationStrategy: PID 31242 died... 05:51:21.376338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminated: ok {rc=0} 05:51:21.423199 --- ParallelTerminationStrategy: PID 31245 died... 05:51:21.443158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminated: ok {rc=0} 05:51:21.489260 --- ParallelTerminationStrategy: PID 31248 died... 05:51:21.508707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminated: ok {rc=0} 05:51:21.597701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 05:51:22.683597 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:22.695016 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 05:51:22.745197 tst ping_idle_ping.py: using LAC 19371 05:51:22.866255 tst ping_idle_ping.py: using RAC 246 05:51:22.987360 tst ping_idle_ping.py: using CellId 19371 05:51:23.110732 tst ping_idle_ping.py: using BVCI 19372 05:51:23.222226 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.232685 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.243290 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.254065 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.264674 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.275317 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.286303 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 05:51:23.297024 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 05:51:23.413048 tst ping_idle_ping.py:24: start network... 05:51:23.634905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:24.143027 run create_hlr_db(pid=31250): Launched 05:51:24.275508 bus /gobi_6: Setting Powered False 05:51:25.339569 run create_hlr_db(pid=31250): Terminated: ok {rc=0} 05:51:25.777208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Launched 05:51:26.082150 run osmo-hlr_10.42.42.2(pid=31253): Launched 05:51:26.197309 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:26.719754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Launched 05:51:27.024761 run osmo-stp_10.42.42.5(pid=31256): Launched 05:51:27.140278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:27.663645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31258): Launched 05:51:27.780148 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:28.036888 run patchelf(pid=31259): Launched 05:51:28.207046 run osmo-stp_10.42.42.5(pid=31256): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] 05:51:28.336403 run osmo-stp_10.42.42.5(pid=31256): stdout: | (launched: 2022-12-09_05:51:26.968305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:28.467658 run osmo-stp_10.42.42.5(pid=31256): stderr: | 20221209055127141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055127141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055127141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055127142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055127142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055127142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055127142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:28.598677 run osmo-stp_10.42.42.5(pid=31256): stdout: | (launched: 2022-12-09_05:51:26.968305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:28.723606 run osmo-stp_10.42.42.5(pid=31256): stderr: | 20221209055127141 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055127141 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055127141 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055127142 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055127142 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055127142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055127142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:28.871402 run patchelf(pid=31259): Terminating (SIGINT) 05:51:29.042452 run patchelf(pid=31259): Terminated: ok {rc=0} 05:51:29.165435 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31256): Process ended prematurely: osmo-stp_10.42.42.5(pid=31256) [trial-2355↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] [trial-2355↪gprs:trx-b200↪ping_idle_ping.py:27] 05:51:29.174488 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:51:29.202175 run osmo-hlr_10.42.42.2(pid=31253): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31253)] 05:51:29.250992 run osmo-hlr_10.42.42.2(pid=31253): stdout: | (launched: 2022-12-09_05:51:26.025865) 05:51:29.301701 run osmo-hlr_10.42.42.2(pid=31253): stderr: | 20221209055126204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055126204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055126204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055126205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055126205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055126205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055126221 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055126231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055126231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055126231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:29.353054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Terminating (SIGTERM) 05:51:29.394537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Terminating (SIGTERM) 05:51:29.435845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31258): Terminating (SIGTERM) 05:51:29.477681 --- ParallelTerminationStrategy: PID 31252 died... 05:51:29.497187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31252): Terminated: ok {rc=0} 05:51:29.542723 --- ParallelTerminationStrategy: PID 31255 died... 05:51:29.561848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31255): Terminated: ok {rc=0} 05:51:29.607469 --- ParallelTerminationStrategy: PID 31258 died... 05:51:29.626556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31258): Terminated: ok {rc=0} 05:51:29.714583 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 05:51:31.051521 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:51:31.061524 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 05:51:31.099278 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 05:51:31.141886 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 05:51:31.234213 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 05:51:31.269257 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 05:51:31.310011 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 05:51:31.908800 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 05:51:31.981398 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:31.995710 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:32.057313 tst cs_paging_gprs_active.py: using LAC 19372 05:51:32.216912 tst cs_paging_gprs_active.py: using RAC 247 05:51:32.343041 tst cs_paging_gprs_active.py: using CellId 19372 05:51:32.468228 tst cs_paging_gprs_active.py: using BVCI 19373 05:51:32.583835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.594988 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.605910 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.617469 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.629196 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.640590 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.652324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.663654 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:32.675104 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:32.796134 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:32.917613 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:51:33.142205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:33.475614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Launched 05:51:33.765518 run iperf3-srv_10.42.42.10(pid=31264): Launched 05:51:33.890434 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:51:34.114662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:34.448105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Launched 05:51:34.737281 run iperf3-srv_10.42.42.10(pid=31266): Launched 05:51:34.862076 tst cs_paging_gprs_active.py:38: start network... 05:51:35.085888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:35.599908 run create_hlr_db(pid=31267): Launched 05:51:35.734733 bus /gobi_6: Setting Powered False 05:51:36.799492 run create_hlr_db(pid=31267): Terminated: ok {rc=0} 05:51:37.241207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31269): Launched 05:51:37.551071 run osmo-hlr_10.42.42.2(pid=31270): Launched 05:51:37.670107 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:38.217465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31272): Launched 05:51:38.527399 run osmo-stp_10.42.42.5(pid=31273): Launched 05:51:38.646420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:39.179969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31275): Launched 05:51:39.299605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:39.561569 run patchelf(pid=31276): Launched 05:51:39.733948 run osmo-stp_10.42.42.5(pid=31273): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31273)] 05:51:39.865280 run osmo-stp_10.42.42.5(pid=31273): stdout: | (launched: 2022-12-09_05:51:38.469639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:39.998091 run osmo-stp_10.42.42.5(pid=31273): stderr: | 20221209055138643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055138643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055138643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055138643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055138644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055138644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055138644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:40.130357 run osmo-stp_10.42.42.5(pid=31273): stdout: | (launched: 2022-12-09_05:51:38.469639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:40.257482 run osmo-stp_10.42.42.5(pid=31273): stderr: | 20221209055138643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055138643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055138643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055138643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055138644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055138644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055138644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:40.407865 run patchelf(pid=31276): Terminating (SIGINT) 05:51:40.582350 run patchelf(pid=31276): Terminated: ok {rc=0} 05:51:40.708064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31273): Process ended prematurely: osmo-stp_10.42.42.5(pid=31273) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31273)] [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 05:51:40.717661 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:51:40.745377 run osmo-hlr_10.42.42.2(pid=31270): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31270)] 05:51:40.794229 run osmo-hlr_10.42.42.2(pid=31270): stdout: | (launched: 2022-12-09_05:51:37.493689) 05:51:40.844646 run osmo-hlr_10.42.42.2(pid=31270): stderr: | 20221209055137674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055137674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055137674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055137674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055137674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055137674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055137687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055137697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055137697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055137697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:40.895183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Terminating (SIGTERM) 05:51:40.935920 run iperf3-srv_10.42.42.10(pid=31264): Terminating (SIGTERM) 05:51:40.976243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Terminating (SIGTERM) 05:51:41.016918 run iperf3-srv_10.42.42.10(pid=31266): Terminating (SIGTERM) 05:51:41.057449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31269): Terminating (SIGTERM) 05:51:41.097969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31272): Terminating (SIGTERM) 05:51:41.138455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31275): Terminating (SIGTERM) 05:51:41.179007 --- ParallelTerminationStrategy: PID 31263 died... 05:51:41.198281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Terminated: ok {rc=0} 05:51:41.243036 --- ParallelTerminationStrategy: PID 31264 died... 05:51:41.261963 run iperf3-srv_10.42.42.10(pid=31264): Terminated {rc=256} 05:51:41.306478 --- ParallelTerminationStrategy: PID 31265 died... 05:51:41.325385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Terminated: ok {rc=0} 05:51:41.370216 --- ParallelTerminationStrategy: PID 31266 died... 05:51:41.388984 run iperf3-srv_10.42.42.10(pid=31266): Terminated {rc=256} 05:51:41.433585 --- ParallelTerminationStrategy: PID 31269 died... 05:51:41.452165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31269): Terminated: ok {rc=0} 05:51:41.496752 --- ParallelTerminationStrategy: PID 31272 died... 05:51:41.515797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31272): Terminated: ok {rc=0} 05:51:41.561199 --- ParallelTerminationStrategy: PID 31275 died... 05:51:41.580069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31275): Terminated: ok {rc=0} 05:51:41.667472 bus /gobi_0: Setting Powered False 05:51:42.769087 bus /gobi_0: Setting Powered False 05:51:43.883272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 05:51:45.033562 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.045459 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:45.100397 tst iperf3.py: using LAC 19373 05:51:45.236658 tst iperf3.py: using RAC 248 05:51:45.368791 tst iperf3.py: using CellId 19373 05:51:45.498366 tst iperf3.py: using BVCI 19374 05:51:45.620530 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.632046 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.643255 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.654507 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.665771 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.677028 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.688325 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.699789 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:45.711190 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:45.826792 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:46.060293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:46.389791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31277): Launched 05:51:46.678156 run iperf3-srv_10.42.42.10(pid=31278): Launched 05:51:46.812734 tst iperf3.py:8: start network... 05:51:47.026158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:51:47.537434 run create_hlr_db(pid=31279): Launched 05:51:47.671253 bus /gobi_6: Setting Powered False 05:51:48.736483 run create_hlr_db(pid=31279): Terminated: ok {rc=0} 05:51:49.194618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Launched 05:51:49.524203 run osmo-hlr_10.42.42.2(pid=31282): Launched 05:51:49.649488 run osmo-stp_10.42.42.5: Starting osmo-stp 05:51:50.218412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Launched 05:51:50.548298 run osmo-stp_10.42.42.5(pid=31285): Launched 05:51:50.673540 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:51:51.243825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Launched 05:51:51.369702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:51:51.649242 run patchelf(pid=31288): Launched 05:51:51.832552 run osmo-stp_10.42.42.5(pid=31285): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] 05:51:51.972111 run osmo-stp_10.42.42.5(pid=31285): stdout: | (launched: 2022-12-09_05:51:50.487503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:52.112632 run osmo-stp_10.42.42.5(pid=31285): stderr: | 20221209055150684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055150685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055150685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055150686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055150686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055150686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055150686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:52.253956 run osmo-stp_10.42.42.5(pid=31285): stdout: | (launched: 2022-12-09_05:51:50.487503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:51:52.389755 run osmo-stp_10.42.42.5(pid=31285): stderr: | 20221209055150684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055150685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055150685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055150686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055150686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055150686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055150686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:51:52.550661 run patchelf(pid=31288): Terminating (SIGINT) 05:51:52.735937 run patchelf(pid=31288): Terminated: ok {rc=0} 05:51:52.868903 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31285): Process ended prematurely: osmo-stp_10.42.42.5(pid=31285) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 05:51:52.879077 tst iperf3.py:8: Test FAILED (7.9 sec) 05:51:52.907584 run osmo-hlr_10.42.42.2(pid=31282): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31282)] 05:51:52.957701 run osmo-hlr_10.42.42.2(pid=31282): stdout: | (launched: 2022-12-09_05:51:49.463710) 05:51:53.009603 run osmo-hlr_10.42.42.2(pid=31282): stderr: | 20221209055149665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055149665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055149665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055149665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055149665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055149665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055149678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055149686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055149686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055149686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:51:53.061961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31277): Terminating (SIGTERM) 05:51:53.104026 run iperf3-srv_10.42.42.10(pid=31278): Terminating (SIGTERM) 05:51:53.146175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminating (SIGTERM) 05:51:53.188250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Terminating (SIGTERM) 05:51:53.230325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Terminating (SIGTERM) 05:51:53.272548 --- ParallelTerminationStrategy: PID 31277 died... 05:51:53.292499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31277): Terminated: ok {rc=0} 05:51:53.339114 --- ParallelTerminationStrategy: PID 31278 died... 05:51:53.358777 run iperf3-srv_10.42.42.10(pid=31278): Terminated {rc=256} 05:51:53.404876 --- ParallelTerminationStrategy: PID 31281 died... 05:51:53.424762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31281): Terminated: ok {rc=0} 05:51:53.470802 --- ParallelTerminationStrategy: PID 31284 died... 05:51:53.490246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31284): Terminated: ok {rc=0} 05:51:53.536634 --- ParallelTerminationStrategy: PID 31287 died... 05:51:53.556287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31287): Terminated: ok {rc=0} 05:51:53.645514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 05:51:54.799114 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:54.811090 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:51:54.862787 tst iperf3m4.py: using LAC 19374 05:51:54.992673 tst iperf3m4.py: using RAC 249 05:51:55.123702 tst iperf3m4.py: using CellId 19374 05:51:55.254957 tst iperf3m4.py: using BVCI 19375 05:51:55.376441 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.387888 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.399073 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.410218 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.421240 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.432359 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.443908 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.455000 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:51:55.466342 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:55.583153 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:55.702448 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:55.823621 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:51:55.946326 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:51:56.170215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:56.503273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Launched 05:51:56.794272 run iperf3-srv_10.42.42.10(pid=31290): Launched 05:51:56.919159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:51:57.143235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:57.460046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Launched 05:51:57.730006 run iperf3-srv_10.42.42.10(pid=31292): Launched 05:51:57.846168 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:51:58.052518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:58.362626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Launched 05:51:58.631719 run iperf3-srv_10.42.42.10(pid=31294): Launched 05:51:58.748531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:51:58.955643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:51:59.266142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Launched 05:51:59.535326 run iperf3-srv_10.42.42.10(pid=31296): Launched 05:51:59.651325 tst iperf3m4.py:8: start network... 05:51:59.858323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:00.338218 run create_hlr_db(pid=31297): Launched 05:52:00.456444 bus /gobi_6: Setting Powered False 05:52:01.545781 run create_hlr_db(pid=31297): Terminated: ok {rc=0} 05:52:02.072447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Launched 05:52:02.402691 run osmo-hlr_10.42.42.2(pid=31300): Launched 05:52:02.520371 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:03.056551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Launched 05:52:03.366398 run osmo-stp_10.42.42.5(pid=31303): Launched 05:52:03.483249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:04.032236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Launched 05:52:04.150505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:04.411145 run patchelf(pid=31306): Launched 05:52:04.583193 run osmo-stp_10.42.42.5(pid=31303): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] 05:52:04.713626 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-09_05:52:03.308830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:04.846229 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221209055203482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055203482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055203482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055203483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055203483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055203483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055203483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:04.978646 run osmo-stp_10.42.42.5(pid=31303): stdout: | (launched: 2022-12-09_05:52:03.308830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:05.105964 run osmo-stp_10.42.42.5(pid=31303): stderr: | 20221209055203482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055203482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055203482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055203483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055203483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055203483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055203483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:05.256879 run patchelf(pid=31306): Terminating (SIGINT) 05:52:05.430244 run patchelf(pid=31306): Terminated: ok {rc=0} 05:52:05.554839 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 05:52:05.564156 tst iperf3m4.py:8: Test FAILED (10.8 sec) 05:52:05.592331 run osmo-hlr_10.42.42.2(pid=31300): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31300)] 05:52:05.640888 run osmo-hlr_10.42.42.2(pid=31300): stdout: | (launched: 2022-12-09_05:52:02.344380) 05:52:05.691080 run osmo-hlr_10.42.42.2(pid=31300): stderr: | 20221209055202524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055202524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055202524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055202524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055202524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055202524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055202536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055202545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055202545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055202545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:05.742280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Terminating (SIGTERM) 05:52:05.782758 run iperf3-srv_10.42.42.10(pid=31290): Terminating (SIGTERM) 05:52:05.823597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Terminating (SIGTERM) 05:52:05.864681 run iperf3-srv_10.42.42.10(pid=31292): Terminating (SIGTERM) 05:52:05.905251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Terminating (SIGTERM) 05:52:05.946164 run iperf3-srv_10.42.42.10(pid=31294): Terminating (SIGTERM) 05:52:05.986814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminating (SIGTERM) 05:52:06.027400 run iperf3-srv_10.42.42.10(pid=31296): Terminating (SIGTERM) 05:52:06.068321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminating (SIGTERM) 05:52:06.109143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminating (SIGTERM) 05:52:06.149873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminating (SIGTERM) 05:52:06.190959 --- ParallelTerminationStrategy: PID 31289 died... 05:52:06.210417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31289): Terminated: ok {rc=0} 05:52:06.255664 --- ParallelTerminationStrategy: PID 31290 died... 05:52:06.274421 run iperf3-srv_10.42.42.10(pid=31290): Terminated {rc=256} 05:52:06.319339 --- ParallelTerminationStrategy: PID 31291 died... 05:52:06.338193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31291): Terminated: ok {rc=0} 05:52:06.383239 --- ParallelTerminationStrategy: PID 31292 died... 05:52:06.402593 run iperf3-srv_10.42.42.10(pid=31292): Terminated {rc=256} 05:52:06.448261 --- ParallelTerminationStrategy: PID 31293 died... 05:52:06.467291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31293): Terminated: ok {rc=0} 05:52:06.512178 --- ParallelTerminationStrategy: PID 31294 died... 05:52:06.530947 run iperf3-srv_10.42.42.10(pid=31294): Terminated {rc=256} 05:52:06.575709 --- ParallelTerminationStrategy: PID 31295 died... 05:52:06.594444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31295): Terminated: ok {rc=0} 05:52:06.639807 --- ParallelTerminationStrategy: PID 31296 died... 05:52:06.658697 run iperf3-srv_10.42.42.10(pid=31296): Terminated {rc=256} 05:52:06.703461 --- ParallelTerminationStrategy: PID 31299 died... 05:52:06.722386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31299): Terminated: ok {rc=0} 05:52:06.767347 --- ParallelTerminationStrategy: PID 31302 died... 05:52:06.786331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31302): Terminated: ok {rc=0} 05:52:06.831840 --- ParallelTerminationStrategy: PID 31305 died... 05:52:06.850725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31305): Terminated: ok {rc=0} 05:52:06.936333 bus /gobi_4: Setting Powered False 05:52:08.037149 bus /gobi_4: Setting Powered False 05:52:09.155240 bus /gobi_1: Setting Powered False 05:52:10.255851 bus /gobi_1: Setting Powered False 05:52:11.373116 bus /gobi_0: Setting Powered False 05:52:12.472728 bus /gobi_0: Setting Powered False 05:52:13.590054 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 05:52:14.694278 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:14.706768 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:14.759315 tst ping.py: using LAC 19375 05:52:14.890819 tst ping.py: using RAC 250 05:52:15.019770 tst ping.py: using CellId 19375 05:52:15.147640 tst ping.py: using BVCI 19376 05:52:15.265748 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.277095 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.288220 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.299450 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.310578 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.321809 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.333144 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:15.344299 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:15.460638 tst ping.py:19: start network... 05:52:15.663334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:16.161791 run create_hlr_db(pid=31308): Launched 05:52:16.332312 bus /gobi_6: Setting Powered False 05:52:17.391900 run create_hlr_db(pid=31308): Terminated: ok {rc=0} 05:52:17.873471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31310): Launched 05:52:18.199298 run osmo-hlr_10.42.42.2(pid=31311): Launched 05:52:18.321917 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:18.887839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31313): Launched 05:52:19.212518 run osmo-stp_10.42.42.5(pid=31314): Launched 05:52:19.335313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:19.897477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31316): Launched 05:52:20.022281 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:20.297755 run patchelf(pid=31317): Launched 05:52:20.479205 run osmo-stp_10.42.42.5(pid=31314): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31314)] 05:52:20.617240 run osmo-stp_10.42.42.5(pid=31314): stdout: | (launched: 2022-12-09_05:52:19.152759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:20.757202 run osmo-stp_10.42.42.5(pid=31314): stderr: | 20221209055219347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055219347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055219347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055219348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055219348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055219348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055219348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:20.897419 run osmo-stp_10.42.42.5(pid=31314): stdout: | (launched: 2022-12-09_05:52:19.152759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:21.030668 run osmo-stp_10.42.42.5(pid=31314): stderr: | 20221209055219347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055219347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055219347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055219348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055219348 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055219348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055219348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:21.188199 run patchelf(pid=31317): Terminating (SIGINT) 05:52:21.370674 run patchelf(pid=31317): Terminated: ok {rc=0} 05:52:21.501939 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31314): Process ended prematurely: osmo-stp_10.42.42.5(pid=31314) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31314)] [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 05:52:21.511606 tst ping.py:22: Test FAILED (6.8 sec) 05:52:21.539952 run osmo-hlr_10.42.42.2(pid=31311): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31311)] 05:52:21.590713 run osmo-hlr_10.42.42.2(pid=31311): stdout: | (launched: 2022-12-09_05:52:18.139593) 05:52:21.643210 run osmo-hlr_10.42.42.2(pid=31311): stderr: | 20221209055218338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055218338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055218338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055218338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055218338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055218339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055218351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055218361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055218362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055218362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:21.695924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31310): Terminating (SIGTERM) 05:52:21.738824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31313): Terminating (SIGTERM) 05:52:21.781679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31316): Terminating (SIGTERM) 05:52:21.824511 --- ParallelTerminationStrategy: PID 31310 died... 05:52:21.844841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31310): Terminated: ok {rc=0} 05:52:21.891893 --- ParallelTerminationStrategy: PID 31313 died... 05:52:21.911810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31313): Terminated: ok {rc=0} 05:52:21.959005 --- ParallelTerminationStrategy: PID 31316 died... 05:52:21.978888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31316): Terminated: ok {rc=0} 05:52:22.067683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 05:52:23.156279 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.168484 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 05:52:23.221946 tst ping_idle_ping.py: using LAC 19376 05:52:23.350659 tst ping_idle_ping.py: using RAC 251 05:52:23.479058 tst ping_idle_ping.py: using CellId 19376 05:52:23.607484 tst ping_idle_ping.py: using BVCI 19377 05:52:23.725562 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.737064 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.748238 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.759577 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.770862 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.782032 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.793482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 05:52:23.804638 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 05:52:23.925637 tst ping_idle_ping.py:24: start network... 05:52:24.145289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:24.650857 run create_hlr_db(pid=31318): Launched 05:52:24.782476 bus /gobi_6: Setting Powered False 05:52:25.847101 run create_hlr_db(pid=31318): Terminated: ok {rc=0} 05:52:26.282871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31320): Launched 05:52:26.587076 run osmo-hlr_10.42.42.2(pid=31321): Launched 05:52:26.703255 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:27.242236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31323): Launched 05:52:27.546884 run osmo-stp_10.42.42.5(pid=31324): Launched 05:52:27.662054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:28.186841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31326): Launched 05:52:28.303938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:28.561875 run patchelf(pid=31327): Launched 05:52:28.731571 run osmo-stp_10.42.42.5(pid=31324): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31324)] 05:52:28.860690 run osmo-stp_10.42.42.5(pid=31324): stdout: | (launched: 2022-12-09_05:52:27.490357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:28.992047 run osmo-stp_10.42.42.5(pid=31324): stderr: | 20221209055227662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055227662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055227662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055227663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055227663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055227663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055227663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:29.122887 run osmo-stp_10.42.42.5(pid=31324): stdout: | (launched: 2022-12-09_05:52:27.490357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:29.247583 run osmo-stp_10.42.42.5(pid=31324): stderr: | 20221209055227662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055227662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055227662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055227663 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055227663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055227663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055227663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:29.395195 run patchelf(pid=31327): Terminating (SIGINT) 05:52:29.566666 run patchelf(pid=31327): Terminated: ok {rc=0} 05:52:29.690177 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31324): Process ended prematurely: osmo-stp_10.42.42.5(pid=31324) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31324)] [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 05:52:29.698921 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 05:52:29.726169 run osmo-hlr_10.42.42.2(pid=31321): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31321)] 05:52:29.775038 run osmo-hlr_10.42.42.2(pid=31321): stdout: | (launched: 2022-12-09_05:52:26.530740) 05:52:29.825468 run osmo-hlr_10.42.42.2(pid=31321): stderr: | 20221209055226707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055226707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055226707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055226707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055226707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055226707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055226728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055226737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055226738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055226738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:29.876408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31320): Terminating (SIGTERM) 05:52:29.917128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31323): Terminating (SIGTERM) 05:52:29.957809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31326): Terminating (SIGTERM) 05:52:29.998759 --- ParallelTerminationStrategy: PID 31320 died... 05:52:30.018176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31320): Terminated: ok {rc=0} 05:52:30.063346 --- ParallelTerminationStrategy: PID 31323 died... 05:52:30.082260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31323): Terminated: ok {rc=0} 05:52:30.127416 --- ParallelTerminationStrategy: PID 31326 died... 05:52:30.146377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31326): Terminated: ok {rc=0} 05:52:30.231792 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 05:52:31.553624 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:52:31.559975 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 05:52:31.597474 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 05:52:31.640097 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 05:52:31.735369 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 05:52:31.779979 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 05:52:31.832248 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 05:52:32.396507 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 05:52:32.450868 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:32.462239 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:32.533500 tst cs_paging_gprs_active.py: using LAC 19377 05:52:32.663578 tst cs_paging_gprs_active.py: using RAC 252 05:52:32.786602 tst cs_paging_gprs_active.py: using CellId 19377 05:52:32.910261 tst cs_paging_gprs_active.py: using BVCI 19378 05:52:33.022997 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.034060 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.045028 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.056232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.067229 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.078255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.089372 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.100142 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:33.111203 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:33.229506 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:33.346488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:52:33.554588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:33.865633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Launched 05:52:34.136116 run iperf3-srv_10.42.42.10(pid=31332): Launched 05:52:34.252277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:52:34.459400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:34.769613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Launched 05:52:35.039744 run iperf3-srv_10.42.42.10(pid=31334): Launched 05:52:35.156779 tst cs_paging_gprs_active.py:38: start network... 05:52:35.363913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:35.854536 run create_hlr_db(pid=31337): Launched 05:52:35.989142 bus /gobi_6: Setting Powered False 05:52:37.050698 run create_hlr_db(pid=31337): Terminated: ok {rc=0} 05:52:37.511898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Launched 05:52:37.845523 run osmo-hlr_10.42.42.2(pid=31340): Launched 05:52:37.971625 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:38.546364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Launched 05:52:38.879078 run osmo-stp_10.42.42.5(pid=31343): Launched 05:52:39.006546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:39.579386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Launched 05:52:39.705872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:39.986639 run patchelf(pid=31346): Launched 05:52:40.170963 run osmo-stp_10.42.42.5(pid=31343): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] 05:52:40.311553 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-09_05:52:38.818217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:40.453053 run osmo-stp_10.42.42.5(pid=31343): stderr: | 20221209055239014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055239014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055239014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055239015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055239015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055239015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055239015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:40.594663 run osmo-stp_10.42.42.5(pid=31343): stdout: | (launched: 2022-12-09_05:52:38.818217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:40.730716 run osmo-stp_10.42.42.5(pid=31343): stderr: | 20221209055239014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055239014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055239014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055239015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055239015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055239015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055239015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:40.891932 run patchelf(pid=31346): Terminating (SIGINT) 05:52:41.077512 run patchelf(pid=31346): Terminated: ok {rc=0} 05:52:41.211371 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 05:52:41.221557 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:52:41.250288 run osmo-hlr_10.42.42.2(pid=31340): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31340)] 05:52:41.301105 run osmo-hlr_10.42.42.2(pid=31340): stdout: | (launched: 2022-12-09_05:52:37.784564) 05:52:41.353482 run osmo-hlr_10.42.42.2(pid=31340): stderr: | 20221209055237986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055237986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055237986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055237986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055237986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055237986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055238000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055238008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055238008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055238008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:41.406258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminating (SIGTERM) 05:52:41.448885 run iperf3-srv_10.42.42.10(pid=31332): Terminating (SIGTERM) 05:52:41.491413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminating (SIGTERM) 05:52:41.534009 run iperf3-srv_10.42.42.10(pid=31334): Terminating (SIGTERM) 05:52:41.576421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminating (SIGTERM) 05:52:41.618907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminating (SIGTERM) 05:52:41.661303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Terminating (SIGTERM) 05:52:41.703895 --- ParallelTerminationStrategy: PID 31331 died... 05:52:41.724428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31331): Terminated: ok {rc=0} 05:52:41.771570 --- ParallelTerminationStrategy: PID 31332 died... 05:52:41.791757 run iperf3-srv_10.42.42.10(pid=31332): Terminated {rc=256} 05:52:41.838801 --- ParallelTerminationStrategy: PID 31333 died... 05:52:41.858738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31333): Terminated: ok {rc=0} 05:52:41.905376 --- ParallelTerminationStrategy: PID 31334 died... 05:52:41.925020 run iperf3-srv_10.42.42.10(pid=31334): Terminated {rc=256} 05:52:41.971429 --- ParallelTerminationStrategy: PID 31339 died... 05:52:41.991117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31339): Terminated: ok {rc=0} 05:52:42.037616 --- ParallelTerminationStrategy: PID 31342 died... 05:52:42.057392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31342): Terminated: ok {rc=0} 05:52:42.103805 --- ParallelTerminationStrategy: PID 31345 died... 05:52:42.123511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31345): Terminated: ok {rc=0} 05:52:42.211478 bus /gobi_0: Setting Powered False 05:52:43.312559 bus /gobi_0: Setting Powered False 05:52:44.429200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 05:52:45.580449 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:45.592524 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:45.666776 tst iperf3.py: using LAC 19378 05:52:45.797112 tst iperf3.py: using RAC 253 05:52:45.943343 tst iperf3.py: using CellId 19378 05:52:46.080235 tst iperf3.py: using BVCI 19379 05:52:46.199082 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.210983 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.222920 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.235406 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.249710 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.261546 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.274438 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.287313 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:46.300013 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:46.421548 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:46.636917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:46.963186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31347): Launched 05:52:47.252933 run iperf3-srv_10.42.42.10(pid=31348): Launched 05:52:47.381480 tst iperf3.py:8: start network... 05:52:47.605060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:52:48.118581 run create_hlr_db(pid=31349): Launched 05:52:48.252262 bus /gobi_6: Setting Powered False 05:52:49.317917 run create_hlr_db(pid=31349): Terminated: ok {rc=0} 05:52:49.758655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31351): Launched 05:52:50.067664 run osmo-hlr_10.42.42.2(pid=31352): Launched 05:52:50.184571 run osmo-stp_10.42.42.5: Starting osmo-stp 05:52:50.728828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31354): Launched 05:52:51.037750 run osmo-stp_10.42.42.5(pid=31355): Launched 05:52:51.155110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:52:51.687677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31357): Launched 05:52:51.806600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:52:52.067590 run patchelf(pid=31358): Launched 05:52:52.238912 run osmo-stp_10.42.42.5(pid=31355): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31355)] 05:52:52.370001 run osmo-stp_10.42.42.5(pid=31355): stdout: | (launched: 2022-12-09_05:52:50.980526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:52.502334 run osmo-stp_10.42.42.5(pid=31355): stderr: | 20221209055251154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055251154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055251154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055251154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055251155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055251155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055251155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:52.634328 run osmo-stp_10.42.42.5(pid=31355): stdout: | (launched: 2022-12-09_05:52:50.980526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:52:52.761993 run osmo-stp_10.42.42.5(pid=31355): stderr: | 20221209055251154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055251154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055251154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055251154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055251155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055251155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055251155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:52:52.912722 run patchelf(pid=31358): Terminating (SIGINT) 05:52:53.086120 run patchelf(pid=31358): Terminated: ok {rc=0} 05:52:53.211149 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31355): Process ended prematurely: osmo-stp_10.42.42.5(pid=31355) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31355)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 05:52:53.220683 tst iperf3.py:8: Test FAILED (7.7 sec) 05:52:53.248783 run osmo-hlr_10.42.42.2(pid=31352): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31352)] 05:52:53.297413 run osmo-hlr_10.42.42.2(pid=31352): stdout: | (launched: 2022-12-09_05:52:50.010833) 05:52:53.347677 run osmo-hlr_10.42.42.2(pid=31352): stderr: | 20221209055250189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055250189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055250189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055250189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055250189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055250189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055250202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055250211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055250211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055250211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:52:53.398486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31347): Terminating (SIGTERM) 05:52:53.439408 run iperf3-srv_10.42.42.10(pid=31348): Terminating (SIGTERM) 05:52:53.480313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31351): Terminating (SIGTERM) 05:52:53.521345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31354): Terminating (SIGTERM) 05:52:53.562145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31357): Terminating (SIGTERM) 05:52:53.603329 --- ParallelTerminationStrategy: PID 31347 died... 05:52:53.622766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31347): Terminated: ok {rc=0} 05:52:53.668153 --- ParallelTerminationStrategy: PID 31348 died... 05:52:53.687053 run iperf3-srv_10.42.42.10(pid=31348): Terminated {rc=256} 05:52:53.732099 --- ParallelTerminationStrategy: PID 31351 died... 05:52:53.751123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31351): Terminated: ok {rc=0} 05:52:53.796191 --- ParallelTerminationStrategy: PID 31354 died... 05:52:53.815286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31354): Terminated: ok {rc=0} 05:52:53.860289 --- ParallelTerminationStrategy: PID 31357 died... 05:52:53.879420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31357): Terminated: ok {rc=0} 05:52:53.964754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 05:52:55.111700 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.123584 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:52:55.193996 tst iperf3m4.py: using LAC 19379 05:52:55.317098 tst iperf3m4.py: using RAC 254 05:52:55.439599 tst iperf3m4.py: using CellId 19379 05:52:55.570178 tst iperf3m4.py: using BVCI 19380 05:52:55.691740 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.703329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.714903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.726703 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.737910 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.749170 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.760509 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.771703 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:52:55.783148 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:55.900409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:56.024063 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:56.143662 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:52:56.261909 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:52:56.486812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:56.821603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31359): Launched 05:52:57.110973 run iperf3-srv_10.42.42.10(pid=31360): Launched 05:52:57.235509 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:52:57.458696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:57.791102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31361): Launched 05:52:58.079622 run iperf3-srv_10.42.42.10(pid=31362): Launched 05:52:58.205732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:52:58.428204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:58.761201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Launched 05:52:59.049677 run iperf3-srv_10.42.42.10(pid=31364): Launched 05:52:59.174158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:52:59.398238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:52:59.729946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Launched 05:53:00.018853 run iperf3-srv_10.42.42.10(pid=31366): Launched 05:53:00.143208 tst iperf3m4.py:8: start network... 05:53:00.365918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:00.885281 run create_hlr_db(pid=31367): Launched 05:53:01.082555 bus /gobi_6: Setting Powered False 05:53:02.167914 run create_hlr_db(pid=31367): Terminated: ok {rc=0} 05:53:02.729286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31439): Launched 05:53:03.119967 run osmo-hlr_10.42.42.2(pid=31475): Launched 05:53:03.366840 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:04.165568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31612): Launched 05:53:04.559385 run osmo-stp_10.42.42.5(pid=31642): Launched 05:53:04.807289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:05.521468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31645): Launched 05:53:05.656702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:05.932583 run patchelf(pid=31646): Launched 05:53:06.130126 run osmo-stp_10.42.42.5(pid=31642): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] 05:53:06.265694 run osmo-stp_10.42.42.5(pid=31642): stdout: | (launched: 2022-12-09_05:53:04.497258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:06.401859 run osmo-stp_10.42.42.5(pid=31642): stderr: | 20221209055304842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055304842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055304843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055304843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055304844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055304844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055304844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:06.538725 run osmo-stp_10.42.42.5(pid=31642): stdout: | (launched: 2022-12-09_05:53:04.497258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:06.671621 run osmo-stp_10.42.42.5(pid=31642): stderr: | 20221209055304842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055304842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055304843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055304843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055304844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055304844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055304844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:06.830477 run patchelf(pid=31646): Terminating (SIGINT) 05:53:07.012187 run patchelf(pid=31646): Terminated: ok {rc=0} 05:53:07.141259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31642): Process ended prematurely: osmo-stp_10.42.42.5(pid=31642) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 05:53:07.151285 tst iperf3m4.py:8: Test FAILED (12.1 sec) 05:53:07.182553 run osmo-hlr_10.42.42.2(pid=31475): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31475)] 05:53:07.235204 run osmo-hlr_10.42.42.2(pid=31475): stdout: | (launched: 2022-12-09_05:53:03.052234) 05:53:07.288830 run osmo-hlr_10.42.42.2(pid=31475): stderr: | 20221209055303437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055303437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055303437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055303437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055303437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055303437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055303455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055303472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055303472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055303472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:07.342368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31359): Terminating (SIGTERM) 05:53:07.386407 run iperf3-srv_10.42.42.10(pid=31360): Terminating (SIGTERM) 05:53:07.433909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31361): Terminating (SIGTERM) 05:53:07.477943 run iperf3-srv_10.42.42.10(pid=31362): Terminating (SIGTERM) 05:53:07.525459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Terminating (SIGTERM) 05:53:07.570021 run iperf3-srv_10.42.42.10(pid=31364): Terminating (SIGTERM) 05:53:07.618463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Terminating (SIGTERM) 05:53:07.663637 run iperf3-srv_10.42.42.10(pid=31366): Terminating (SIGTERM) 05:53:07.710064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31439): Terminating (SIGTERM) 05:53:07.754031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31612): Terminating (SIGTERM) 05:53:07.799097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31645): Terminating (SIGTERM) 05:53:07.845073 --- ParallelTerminationStrategy: PID 31359 died... 05:53:07.865228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31359): Terminated: ok {rc=0} 05:53:07.916047 --- ParallelTerminationStrategy: PID 31360 died... 05:53:07.935892 run iperf3-srv_10.42.42.10(pid=31360): Terminated {rc=256} 05:53:07.984064 --- ParallelTerminationStrategy: PID 31361 died... 05:53:08.004089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31361): Terminated: ok {rc=0} 05:53:08.053632 --- ParallelTerminationStrategy: PID 31362 died... 05:53:08.073404 run iperf3-srv_10.42.42.10(pid=31362): Terminated {rc=256} 05:53:08.121556 --- ParallelTerminationStrategy: PID 31363 died... 05:53:08.141865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31363): Terminated: ok {rc=0} 05:53:08.190350 --- ParallelTerminationStrategy: PID 31364 died... 05:53:08.211182 run iperf3-srv_10.42.42.10(pid=31364): Terminated {rc=256} 05:53:08.259308 --- ParallelTerminationStrategy: PID 31365 died... 05:53:08.280330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31365): Terminated: ok {rc=0} 05:53:08.329478 --- ParallelTerminationStrategy: PID 31366 died... 05:53:08.349587 run iperf3-srv_10.42.42.10(pid=31366): Terminated {rc=256} 05:53:08.399967 --- ParallelTerminationStrategy: PID 31439 died... 05:53:08.421147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31439): Terminated: ok {rc=0} 05:53:08.471867 --- ParallelTerminationStrategy: PID 31612 died... 05:53:08.492157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31612): Terminated: ok {rc=0} 05:53:08.540230 --- ParallelTerminationStrategy: PID 31645 died... 05:53:08.560493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31645): Terminated: ok {rc=0} 05:53:08.651622 bus /gobi_4: Setting Powered False 05:53:09.753363 bus /gobi_4: Setting Powered False 05:53:10.873578 bus /gobi_1: Setting Powered False 05:53:11.976685 bus /gobi_1: Setting Powered False 05:53:13.095832 bus /gobi_0: Setting Powered False 05:53:14.199048 bus /gobi_0: Setting Powered False 05:53:15.320763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 05:53:16.462749 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:16.478491 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:16.565998 tst ping.py: using LAC 19380 05:53:16.718694 tst ping.py: using RAC 255 05:53:16.871292 tst ping.py: using CellId 19380 05:53:17.043005 tst ping.py: using BVCI 19381 05:53:17.200483 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.215641 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.230815 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.246089 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.261105 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.277085 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.293395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:17.308312 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:17.457110 tst ping.py:19: start network... 05:53:17.722559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:18.217684 run create_hlr_db(pid=31649): Launched 05:53:18.373620 bus /gobi_6: Setting Powered False 05:53:19.436302 run create_hlr_db(pid=31649): Terminated: ok {rc=0} 05:53:19.881401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Launched 05:53:20.216096 run osmo-hlr_10.42.42.2(pid=31652): Launched 05:53:20.461562 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:21.210464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Launched 05:53:21.546761 run osmo-stp_10.42.42.5(pid=31655): Launched 05:53:21.790935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:22.510655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Launched 05:53:22.647335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:22.922176 run patchelf(pid=31658): Launched 05:53:23.113487 run osmo-stp_10.42.42.5(pid=31655): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] 05:53:23.249987 run osmo-stp_10.42.42.5(pid=31655): stdout: | (launched: 2022-12-09_05:53:21.482376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:23.388207 run osmo-stp_10.42.42.5(pid=31655): stderr: | 20221209055321820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055321820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055321820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055321825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055321827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055321827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055321827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:23.526187 run osmo-stp_10.42.42.5(pid=31655): stdout: | (launched: 2022-12-09_05:53:21.482376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:23.658309 run osmo-stp_10.42.42.5(pid=31655): stderr: | 20221209055321820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055321820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055321820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055321825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055321827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055321827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055321827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:23.815435 run patchelf(pid=31658): Terminating (SIGINT) 05:53:23.995125 run patchelf(pid=31658): Terminated: ok {rc=0} 05:53:24.126720 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31655): Process ended prematurely: osmo-stp_10.42.42.5(pid=31655) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 05:53:24.136703 tst ping.py:22: Test FAILED (7.7 sec) 05:53:24.167727 run osmo-hlr_10.42.42.2(pid=31652): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31652)] 05:53:24.221092 run osmo-hlr_10.42.42.2(pid=31652): stdout: | (launched: 2022-12-09_05:53:20.153966) 05:53:24.286247 run osmo-hlr_10.42.42.2(pid=31652): stderr: | 20221209055320508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055320508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055320508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055320508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055320508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055320508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055320527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055320540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055320540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055320540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:24.338095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Terminating (SIGTERM) 05:53:24.379567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Terminating (SIGTERM) 05:53:24.420667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Terminating (SIGTERM) 05:53:24.462607 --- ParallelTerminationStrategy: PID 31651 died... 05:53:24.481823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31651): Terminated: ok {rc=0} 05:53:24.527366 --- ParallelTerminationStrategy: PID 31654 died... 05:53:24.546388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31654): Terminated: ok {rc=0} 05:53:24.592182 --- ParallelTerminationStrategy: PID 31657 died... 05:53:24.611223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31657): Terminated: ok {rc=0} 05:53:24.699242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 05:53:25.788316 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:25.800079 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 05:53:25.870950 tst ping_idle_ping.py: using LAC 19381 05:53:25.991083 tst ping_idle_ping.py: using RAC 1 05:53:26.114537 tst ping_idle_ping.py: using CellId 19381 05:53:26.234513 tst ping_idle_ping.py: using BVCI 19382 05:53:26.345447 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.356556 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.367375 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.378570 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.389741 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.400713 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.411800 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 05:53:26.422844 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 05:53:26.543637 tst ping_idle_ping.py:24: start network... 05:53:26.766046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:27.278336 run create_hlr_db(pid=31659): Launched 05:53:27.410585 bus /gobi_6: Setting Powered False 05:53:28.474527 run create_hlr_db(pid=31659): Terminated: ok {rc=0} 05:53:28.910204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Launched 05:53:29.215962 run osmo-hlr_10.42.42.2(pid=31662): Launched 05:53:29.331183 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:29.869287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Launched 05:53:30.173151 run osmo-stp_10.42.42.5(pid=31665): Launched 05:53:30.288037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:30.810834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31667): Launched 05:53:30.945690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:31.227364 run patchelf(pid=31668): Launched 05:53:31.416359 run osmo-stp_10.42.42.5(pid=31665): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] 05:53:31.549990 run osmo-stp_10.42.42.5(pid=31665): stdout: | (launched: 2022-12-09_05:53:30.117227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:31.726444 run osmo-stp_10.42.42.5(pid=31665): stderr: | 20221209055330291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055330292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055330292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055330292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055330293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055330293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055330293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:31.909763 run osmo-stp_10.42.42.5(pid=31665): stdout: | (launched: 2022-12-09_05:53:30.117227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:32.081929 run osmo-stp_10.42.42.5(pid=31665): stderr: | 20221209055330291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055330292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055330292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055330292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055330293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055330293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055330293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:32.277891 run patchelf(pid=31668): Terminating (SIGINT) 05:53:32.463243 run patchelf(pid=31668): Terminated: ok {rc=0} 05:53:32.595175 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31665): Process ended prematurely: osmo-stp_10.42.42.5(pid=31665) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 05:53:32.604604 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 05:53:32.632863 run osmo-hlr_10.42.42.2(pid=31662): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31662)] 05:53:32.683567 run osmo-hlr_10.42.42.2(pid=31662): stdout: | (launched: 2022-12-09_05:53:29.159378) 05:53:32.736078 run osmo-hlr_10.42.42.2(pid=31662): stderr: | 20221209055329339 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055329339 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055329339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055329339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055329339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055329339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055329352 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055329363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055329363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055329363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:32.789459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Terminating (SIGTERM) 05:53:32.831815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Terminating (SIGTERM) 05:53:32.874345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31667): Terminating (SIGTERM) 05:53:32.917104 --- ParallelTerminationStrategy: PID 31661 died... 05:53:32.937203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Terminated: ok {rc=0} 05:53:32.983797 --- ParallelTerminationStrategy: PID 31664 died... 05:53:33.003503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Terminated: ok {rc=0} 05:53:33.049865 --- ParallelTerminationStrategy: PID 31667 died... 05:53:33.069536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31667): Terminated: ok {rc=0} 05:53:33.157924 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:53:34.457989 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:53:34.463976 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:53:34.499407 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 05:53:34.538505 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 05:53:34.624088 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:53:34.658686 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 05:53:34.698293 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 05:53:35.290700 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 05:53:35.342761 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.353911 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:35.422535 tst cs_paging_gprs_active.py: using LAC 19382 05:53:35.542393 tst cs_paging_gprs_active.py: using RAC 2 05:53:35.663629 tst cs_paging_gprs_active.py: using CellId 19382 05:53:35.795286 tst cs_paging_gprs_active.py: using BVCI 19383 05:53:35.909928 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.920697 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.931576 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.942614 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.953639 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.964506 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.975572 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.986570 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:35.997893 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:36.119650 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:36.239614 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:53:36.448424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:36.760143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31672): Launched 05:53:37.031599 run iperf3-srv_10.42.42.10(pid=31673): Launched 05:53:37.148770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:53:37.356356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:37.669176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31674): Launched 05:53:37.940071 run iperf3-srv_10.42.42.10(pid=31675): Launched 05:53:38.056400 tst cs_paging_gprs_active.py:38: start network... 05:53:38.268379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:38.785707 run create_hlr_db(pid=31676): Launched 05:53:38.920756 bus /gobi_6: Setting Powered False 05:53:39.986424 run create_hlr_db(pid=31676): Terminated: ok {rc=0} 05:53:40.447547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31678): Launched 05:53:40.779465 run osmo-hlr_10.42.42.2(pid=31679): Launched 05:53:40.905717 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:41.474238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31681): Launched 05:53:41.808051 run osmo-stp_10.42.42.5(pid=31682): Launched 05:53:41.934037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:42.507311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31684): Launched 05:53:42.634347 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:42.915537 run patchelf(pid=31685): Launched 05:53:43.100311 run osmo-stp_10.42.42.5(pid=31682): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31682)] 05:53:43.240681 run osmo-stp_10.42.42.5(pid=31682): stdout: | (launched: 2022-12-09_05:53:41.746621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:43.383040 run osmo-stp_10.42.42.5(pid=31682): stderr: | 20221209055341942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055341942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055341942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055341943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055341945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055341945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055341945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:43.525686 run osmo-stp_10.42.42.5(pid=31682): stdout: | (launched: 2022-12-09_05:53:41.746621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:43.662114 run osmo-stp_10.42.42.5(pid=31682): stderr: | 20221209055341942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055341942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055341942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055341943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055341945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055341945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055341945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:43.823978 run patchelf(pid=31685): Terminating (SIGINT) 05:53:44.009973 run patchelf(pid=31685): Terminated: ok {rc=0} 05:53:44.144530 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31682): Process ended prematurely: osmo-stp_10.42.42.5(pid=31682) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31682)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 05:53:44.154753 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 05:53:44.183648 run osmo-hlr_10.42.42.2(pid=31679): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31679)] 05:53:44.234744 run osmo-hlr_10.42.42.2(pid=31679): stdout: | (launched: 2022-12-09_05:53:40.718413) 05:53:44.287689 run osmo-hlr_10.42.42.2(pid=31679): stderr: | 20221209055340921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055340921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055340921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055340921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055340921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055340921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055340934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055340942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055340943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055340943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:44.341144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31672): Terminating (SIGTERM) 05:53:44.384124 run iperf3-srv_10.42.42.10(pid=31673): Terminating (SIGTERM) 05:53:44.426972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31674): Terminating (SIGTERM) 05:53:44.470022 run iperf3-srv_10.42.42.10(pid=31675): Terminating (SIGTERM) 05:53:44.513007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31678): Terminating (SIGTERM) 05:53:44.556011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31681): Terminating (SIGTERM) 05:53:44.599000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31684): Terminating (SIGTERM) 05:53:44.642525 --- ParallelTerminationStrategy: PID 31672 died... 05:53:44.662849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31672): Terminated: ok {rc=0} 05:53:44.710062 --- ParallelTerminationStrategy: PID 31673 died... 05:53:44.729965 run iperf3-srv_10.42.42.10(pid=31673): Terminated {rc=256} 05:53:44.777355 --- ParallelTerminationStrategy: PID 31674 died... 05:53:44.797421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31674): Terminated: ok {rc=0} 05:53:44.844423 --- ParallelTerminationStrategy: PID 31675 died... 05:53:44.864226 run iperf3-srv_10.42.42.10(pid=31675): Terminated {rc=256} 05:53:44.911134 --- ParallelTerminationStrategy: PID 31678 died... 05:53:44.931027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31678): Terminated: ok {rc=0} 05:53:44.978141 --- ParallelTerminationStrategy: PID 31681 died... 05:53:44.998167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31681): Terminated: ok {rc=0} 05:53:45.045331 --- ParallelTerminationStrategy: PID 31684 died... 05:53:45.065304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31684): Terminated: ok {rc=0} 05:53:45.153968 bus /gobi_0: Setting Powered False 05:53:46.253493 bus /gobi_0: Setting Powered False 05:53:47.373821 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 05:53:48.522626 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:48.534473 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:48.607761 tst iperf3.py: using LAC 19383 05:53:48.729335 tst iperf3.py: using RAC 3 05:53:48.852560 tst iperf3.py: using CellId 19383 05:53:48.975648 tst iperf3.py: using BVCI 19384 05:53:49.089357 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.100229 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.110913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.121947 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.132819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.143811 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.154857 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.165957 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:49.176906 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:49.299111 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:49.523808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:49.857856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Launched 05:53:50.146919 run iperf3-srv_10.42.42.10(pid=31687): Launched 05:53:50.271865 tst iperf3.py:8: start network... 05:53:50.496001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:53:51.010952 run create_hlr_db(pid=31688): Launched 05:53:51.146147 bus /gobi_6: Setting Powered False 05:53:52.211740 run create_hlr_db(pid=31688): Terminated: ok {rc=0} 05:53:52.652436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31690): Launched 05:53:52.961999 run osmo-hlr_10.42.42.2(pid=31691): Launched 05:53:53.079627 run osmo-stp_10.42.42.5: Starting osmo-stp 05:53:53.629087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Launched 05:53:53.938633 run osmo-stp_10.42.42.5(pid=31694): Launched 05:53:54.056323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:53:54.587961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31696): Launched 05:53:54.707017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:53:54.968722 run patchelf(pid=31697): Launched 05:53:55.140627 run osmo-stp_10.42.42.5(pid=31694): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31694)] 05:53:55.271874 run osmo-stp_10.42.42.5(pid=31694): stdout: | (launched: 2022-12-09_05:53:53.881271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:55.404284 run osmo-stp_10.42.42.5(pid=31694): stderr: | 20221209055354052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055354052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055354053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055354053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055354055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055354056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055354056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:55.537092 run osmo-stp_10.42.42.5(pid=31694): stdout: | (launched: 2022-12-09_05:53:53.881271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:53:55.665228 run osmo-stp_10.42.42.5(pid=31694): stderr: | 20221209055354052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055354052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055354053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055354053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055354055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055354056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055354056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:53:55.816354 run patchelf(pid=31697): Terminating (SIGINT) 05:53:55.990186 run patchelf(pid=31697): Terminated: ok {rc=0} 05:53:56.115540 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31694): Process ended prematurely: osmo-stp_10.42.42.5(pid=31694) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31694)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 05:53:56.125131 tst iperf3.py:8: Test FAILED (7.6 sec) 05:53:56.153103 run osmo-hlr_10.42.42.2(pid=31691): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31691)] 05:53:56.201995 run osmo-hlr_10.42.42.2(pid=31691): stdout: | (launched: 2022-12-09_05:53:52.905186) 05:53:56.252717 run osmo-hlr_10.42.42.2(pid=31691): stderr: | 20221209055353082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055353082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055353082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055353082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055353082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055353082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055353095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055353105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055353105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055353105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:53:56.303773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Terminating (SIGTERM) 05:53:56.344636 run iperf3-srv_10.42.42.10(pid=31687): Terminating (SIGTERM) 05:53:56.385538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31690): Terminating (SIGTERM) 05:53:56.426508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Terminating (SIGTERM) 05:53:56.467404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31696): Terminating (SIGTERM) 05:53:56.508551 --- ParallelTerminationStrategy: PID 31686 died... 05:53:56.528037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Terminated: ok {rc=0} 05:53:56.573560 --- ParallelTerminationStrategy: PID 31687 died... 05:53:56.592393 run iperf3-srv_10.42.42.10(pid=31687): Terminated {rc=256} 05:53:56.637716 --- ParallelTerminationStrategy: PID 31690 died... 05:53:56.656673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31690): Terminated: ok {rc=0} 05:53:56.701885 --- ParallelTerminationStrategy: PID 31693 died... 05:53:56.720907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Terminated: ok {rc=0} 05:53:56.766266 --- ParallelTerminationStrategy: PID 31696 died... 05:53:56.785304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31696): Terminated: ok {rc=0} 05:53:56.874896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 05:53:58.024765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.036399 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:53:58.110310 tst iperf3m4.py: using LAC 19384 05:53:58.231490 tst iperf3m4.py: using RAC 4 05:53:58.361912 tst iperf3m4.py: using CellId 19384 05:53:58.490546 tst iperf3m4.py: using BVCI 19385 05:53:58.613741 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.625463 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.636862 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.648520 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.659799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.671186 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.682709 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.694055 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:53:58.705728 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:58.824644 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:58.946185 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:59.066801 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:53:59.184758 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:53:59.393103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:53:59.717885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Launched 05:54:00.006851 run iperf3-srv_10.42.42.10(pid=31699): Launched 05:54:00.131750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:54:00.355745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:00.688444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Launched 05:54:01.007606 run iperf3-srv_10.42.42.10(pid=31701): Launched 05:54:01.160091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:54:01.397318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:01.751686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31702): Launched 05:54:02.050720 run iperf3-srv_10.42.42.10(pid=31703): Launched 05:54:02.186298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:54:02.410847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:02.743478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31704): Launched 05:54:03.031815 run iperf3-srv_10.42.42.10(pid=31705): Launched 05:54:03.155792 tst iperf3m4.py:8: start network... 05:54:03.378627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:03.892584 run create_hlr_db(pid=31706): Launched 05:54:04.026927 bus /gobi_6: Setting Powered False 05:54:05.091439 run create_hlr_db(pid=31706): Terminated: ok {rc=0} 05:54:05.551619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Launched 05:54:05.883167 run osmo-hlr_10.42.42.2(pid=31709): Launched 05:54:06.008274 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:06.580645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Launched 05:54:06.910933 run osmo-stp_10.42.42.5(pid=31712): Launched 05:54:07.035735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:07.604935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Launched 05:54:07.731623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:08.011853 run patchelf(pid=31715): Launched 05:54:08.195511 run osmo-stp_10.42.42.5(pid=31712): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] 05:54:08.335629 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-09_05:54:06.850327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:08.476636 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221209055407043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055407044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055407044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055407044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055407045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055407045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055407045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:08.618043 run osmo-stp_10.42.42.5(pid=31712): stdout: | (launched: 2022-12-09_05:54:06.850327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:08.754754 run osmo-stp_10.42.42.5(pid=31712): stderr: | 20221209055407043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055407044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055407044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055407044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055407045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055407045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055407045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:08.916293 run patchelf(pid=31715): Terminating (SIGINT) 05:54:09.101595 run patchelf(pid=31715): Terminated: ok {rc=0} 05:54:09.235274 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 05:54:09.245413 tst iperf3m4.py:8: Test FAILED (11.3 sec) 05:54:09.274566 run osmo-hlr_10.42.42.2(pid=31709): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31709)] 05:54:09.325500 run osmo-hlr_10.42.42.2(pid=31709): stdout: | (launched: 2022-12-09_05:54:05.822489) 05:54:09.378225 run osmo-hlr_10.42.42.2(pid=31709): stderr: | 20221209055406022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055406022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055406022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055406022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055406022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055406022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055406035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055406046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055406046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055406046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:09.431198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminating (SIGTERM) 05:54:09.474151 run iperf3-srv_10.42.42.10(pid=31699): Terminating (SIGTERM) 05:54:09.517065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminating (SIGTERM) 05:54:09.560031 run iperf3-srv_10.42.42.10(pid=31701): Terminating (SIGTERM) 05:54:09.602744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31702): Terminating (SIGTERM) 05:54:09.645510 run iperf3-srv_10.42.42.10(pid=31703): Terminating (SIGTERM) 05:54:09.688010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31704): Terminating (SIGTERM) 05:54:09.731254 run iperf3-srv_10.42.42.10(pid=31705): Terminating (SIGTERM) 05:54:09.774263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminating (SIGTERM) 05:54:09.817122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminating (SIGTERM) 05:54:09.860044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminating (SIGTERM) 05:54:09.902858 --- ParallelTerminationStrategy: PID 31698 died... 05:54:09.922987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminated: ok {rc=0} 05:54:09.970654 --- ParallelTerminationStrategy: PID 31699 died... 05:54:09.990535 run iperf3-srv_10.42.42.10(pid=31699): Terminated {rc=256} 05:54:10.037531 --- ParallelTerminationStrategy: PID 31700 died... 05:54:10.057382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminated: ok {rc=0} 05:54:10.104273 --- ParallelTerminationStrategy: PID 31701 died... 05:54:10.124175 run iperf3-srv_10.42.42.10(pid=31701): Terminated {rc=256} 05:54:10.170952 --- ParallelTerminationStrategy: PID 31702 died... 05:54:10.190902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31702): Terminated: ok {rc=0} 05:54:10.237736 --- ParallelTerminationStrategy: PID 31703 died... 05:54:10.257601 run iperf3-srv_10.42.42.10(pid=31703): Terminated {rc=256} 05:54:10.304282 --- ParallelTerminationStrategy: PID 31704 died... 05:54:10.324309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31704): Terminated: ok {rc=0} 05:54:10.371282 --- ParallelTerminationStrategy: PID 31705 died... 05:54:10.391156 run iperf3-srv_10.42.42.10(pid=31705): Terminated {rc=256} 05:54:10.438004 --- ParallelTerminationStrategy: PID 31708 died... 05:54:10.457941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31708): Terminated: ok {rc=0} 05:54:10.505175 --- ParallelTerminationStrategy: PID 31711 died... 05:54:10.525080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31711): Terminated: ok {rc=0} 05:54:10.572093 --- ParallelTerminationStrategy: PID 31714 died... 05:54:10.592205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31714): Terminated: ok {rc=0} 05:54:10.681915 bus /gobi_4: Setting Powered False 05:54:11.779661 bus /gobi_4: Setting Powered False 05:54:12.896150 bus /gobi_1: Setting Powered False 05:54:13.996925 bus /gobi_1: Setting Powered False 05:54:15.114328 bus /gobi_0: Setting Powered False 05:54:16.213220 bus /gobi_0: Setting Powered False 05:54:17.331265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 05:54:18.436617 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:18.448896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:18.521824 tst ping.py: using LAC 19385 05:54:18.650884 tst ping.py: using RAC 5 05:54:18.780153 tst ping.py: using CellId 19385 05:54:18.908314 tst ping.py: using BVCI 19386 05:54:19.027815 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.039397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.050981 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.062411 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.073596 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.084655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.096033 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:19.107432 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:19.228688 tst ping.py:19: start network... 05:54:19.450089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:19.954439 run create_hlr_db(pid=31716): Launched 05:54:20.085721 bus /gobi_6: Setting Powered False 05:54:21.149959 run create_hlr_db(pid=31716): Terminated: ok {rc=0} 05:54:21.586976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Launched 05:54:21.893972 run osmo-hlr_10.42.42.2(pid=31719): Launched 05:54:22.009490 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:22.552707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Launched 05:54:22.857579 run osmo-stp_10.42.42.5(pid=31722): Launched 05:54:22.973867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:23.497047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Launched 05:54:23.613439 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:23.870184 run patchelf(pid=31725): Launched 05:54:24.038990 run osmo-stp_10.42.42.5(pid=31722): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] 05:54:24.167467 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-09_05:54:22.800517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:24.297482 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221209055422973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055422973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055422974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055422974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055422975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055422975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055422975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:24.427392 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-09_05:54:22.800517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:24.551481 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221209055422973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055422973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055422974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055422974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055422975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055422975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055422975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:24.698702 run patchelf(pid=31725): Terminating (SIGINT) 05:54:24.868495 run patchelf(pid=31725): Terminated: ok {rc=0} 05:54:24.991213 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 05:54:24.999987 tst ping.py:22: Test FAILED (6.6 sec) 05:54:25.027582 run osmo-hlr_10.42.42.2(pid=31719): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31719)] 05:54:25.076033 run osmo-hlr_10.42.42.2(pid=31719): stdout: | (launched: 2022-12-09_05:54:21.837038) 05:54:25.126019 run osmo-hlr_10.42.42.2(pid=31719): stderr: | 20221209055422012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055422012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055422012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055422012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055422012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055422012 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055422028 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055422038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055422038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055422038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:25.176201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminating (SIGTERM) 05:54:25.216818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminating (SIGTERM) 05:54:25.257231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Terminating (SIGTERM) 05:54:25.298349 --- ParallelTerminationStrategy: PID 31718 died... 05:54:25.317594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminated: ok {rc=0} 05:54:25.362334 --- ParallelTerminationStrategy: PID 31721 died... 05:54:25.381053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminated: ok {rc=0} 05:54:25.425890 --- ParallelTerminationStrategy: PID 31724 died... 05:54:25.444720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31724): Terminated: ok {rc=0} 05:54:25.532292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 05:54:26.622515 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:26.634681 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:54:26.707037 tst ping_idle_ping.py: using LAC 19386 05:54:26.827078 tst ping_idle_ping.py: using RAC 6 05:54:26.946925 tst ping_idle_ping.py: using CellId 19386 05:54:27.071546 tst ping_idle_ping.py: using BVCI 19387 05:54:27.183018 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.194150 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.205027 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.216315 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.227308 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.238341 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.249510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 05:54:27.260343 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 05:54:27.379183 tst ping_idle_ping.py:24: start network... 05:54:27.600192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:28.107637 run create_hlr_db(pid=31727): Launched 05:54:28.239603 bus /gobi_6: Setting Powered False 05:54:29.303661 run create_hlr_db(pid=31727): Terminated: ok {rc=0} 05:54:29.738875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31729): Launched 05:54:30.045192 run osmo-hlr_10.42.42.2(pid=31730): Launched 05:54:30.161261 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:30.684745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31732): Launched 05:54:31.029704 run osmo-stp_10.42.42.5(pid=31733): Launched 05:54:31.172034 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:31.931771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31735): Launched 05:54:32.066701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:32.347067 run patchelf(pid=31736): Launched 05:54:32.529348 run osmo-stp_10.42.42.5(pid=31733): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31733)] 05:54:32.667921 run osmo-stp_10.42.42.5(pid=31733): stdout: | (launched: 2022-12-09_05:54:30.961753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:32.808269 run osmo-stp_10.42.42.5(pid=31733): stderr: | 20221209055431308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055431317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055431317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055431318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055431318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055431318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055431318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:32.947955 run osmo-stp_10.42.42.5(pid=31733): stdout: | (launched: 2022-12-09_05:54:30.961753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:33.081784 run osmo-stp_10.42.42.5(pid=31733): stderr: | 20221209055431308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055431317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055431317 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055431318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055431318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055431318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055431318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:33.240225 run patchelf(pid=31736): Terminating (SIGINT) 05:54:33.422972 run patchelf(pid=31736): Terminated: ok {rc=0} 05:54:33.554498 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31733): Process ended prematurely: osmo-stp_10.42.42.5(pid=31733) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31733)] [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 05:54:33.564345 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 05:54:33.593133 run osmo-hlr_10.42.42.2(pid=31730): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31730)] 05:54:33.643933 run osmo-hlr_10.42.42.2(pid=31730): stdout: | (launched: 2022-12-09_05:54:29.988878) 05:54:33.696463 run osmo-hlr_10.42.42.2(pid=31730): stderr: | 20221209055430163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055430163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055430163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055430163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055430163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055430163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055430174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055430183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055430183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055430183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:33.749426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31729): Terminating (SIGTERM) 05:54:33.792271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31732): Terminating (SIGTERM) 05:54:33.835071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31735): Terminating (SIGTERM) 05:54:33.877840 --- ParallelTerminationStrategy: PID 31729 died... 05:54:33.898152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31729): Terminated: ok {rc=0} 05:54:33.945639 --- ParallelTerminationStrategy: PID 31732 died... 05:54:33.965394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31732): Terminated: ok {rc=0} 05:54:34.012184 --- ParallelTerminationStrategy: PID 31735 died... 05:54:34.032039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31735): Terminated: ok {rc=0} 05:54:34.120507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 05:54:35.428855 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:54:35.436128 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 05:54:35.470936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 05:54:35.511168 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 05:54:35.602423 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 05:54:35.637005 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 05:54:35.676733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 05:54:36.276575 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 05:54:36.330570 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.342690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:36.396855 tst cs_paging_gprs_active.py: using LAC 19387 05:54:36.527185 tst cs_paging_gprs_active.py: using RAC 7 05:54:36.659985 tst cs_paging_gprs_active.py: using CellId 19387 05:54:36.792648 tst cs_paging_gprs_active.py: using BVCI 19388 05:54:36.914332 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.926436 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.938255 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.950371 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.962366 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.974372 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.986977 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:36.998747 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:37.011099 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:37.130898 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:37.249081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:54:37.458134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:37.770865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31741): Launched 05:54:38.041506 run iperf3-srv_10.42.42.10(pid=31742): Launched 05:54:38.158279 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:54:38.365836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:38.676591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31743): Launched 05:54:38.947648 run iperf3-srv_10.42.42.10(pid=31744): Launched 05:54:39.065381 tst cs_paging_gprs_active.py:38: start network... 05:54:39.272367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:39.752350 run create_hlr_db(pid=31745): Launched 05:54:39.871450 bus /gobi_6: Setting Powered False 05:54:40.933729 run create_hlr_db(pid=31745): Terminated: ok {rc=0} 05:54:41.385492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31747): Launched 05:54:41.718063 run osmo-hlr_10.42.42.2(pid=31748): Launched 05:54:41.844842 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:42.419684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31750): Launched 05:54:42.751635 run osmo-stp_10.42.42.5(pid=31751): Launched 05:54:42.878196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:43.450755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31753): Launched 05:54:43.577911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:43.858670 run patchelf(pid=31754): Launched 05:54:44.043958 run osmo-stp_10.42.42.5(pid=31751): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31751)] 05:54:44.184430 run osmo-stp_10.42.42.5(pid=31751): stdout: | (launched: 2022-12-09_05:54:42.690746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:44.326357 run osmo-stp_10.42.42.5(pid=31751): stderr: | 20221209055442884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055442884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055442884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055442885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055442887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055442887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055442887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:44.468324 run osmo-stp_10.42.42.5(pid=31751): stdout: | (launched: 2022-12-09_05:54:42.690746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:44.604496 run osmo-stp_10.42.42.5(pid=31751): stderr: | 20221209055442884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055442884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055442884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055442885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055442887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055442887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055442887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:44.766524 run patchelf(pid=31754): Terminating (SIGINT) 05:54:44.952163 run patchelf(pid=31754): Terminated: ok {rc=0} 05:54:45.086132 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31751): Process ended prematurely: osmo-stp_10.42.42.5(pid=31751) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31751)] [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 05:54:45.096421 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 05:54:45.125959 run osmo-hlr_10.42.42.2(pid=31748): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31748)] 05:54:45.177239 run osmo-hlr_10.42.42.2(pid=31748): stdout: | (launched: 2022-12-09_05:54:41.656873) 05:54:45.230212 run osmo-hlr_10.42.42.2(pid=31748): stderr: | 20221209055441880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055441880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055441881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055441881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055441881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055441881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055441893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055441903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055441903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055441903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:45.283476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31741): Terminating (SIGTERM) 05:54:45.326650 run iperf3-srv_10.42.42.10(pid=31742): Terminating (SIGTERM) 05:54:45.369746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31743): Terminating (SIGTERM) 05:54:45.412793 run iperf3-srv_10.42.42.10(pid=31744): Terminating (SIGTERM) 05:54:45.455805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31747): Terminating (SIGTERM) 05:54:45.498864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31750): Terminating (SIGTERM) 05:54:45.541913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31753): Terminating (SIGTERM) 05:54:45.585340 --- ParallelTerminationStrategy: PID 31741 died... 05:54:45.605754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31741): Terminated: ok {rc=0} 05:54:45.653350 --- ParallelTerminationStrategy: PID 31742 died... 05:54:45.673307 run iperf3-srv_10.42.42.10(pid=31742): Terminated {rc=256} 05:54:45.720684 --- ParallelTerminationStrategy: PID 31743 died... 05:54:45.740729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31743): Terminated: ok {rc=0} 05:54:45.788349 --- ParallelTerminationStrategy: PID 31744 died... 05:54:45.808282 run iperf3-srv_10.42.42.10(pid=31744): Terminated {rc=256} 05:54:45.872189 --- ParallelTerminationStrategy: PID 31747 died... 05:54:45.896109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31747): Terminated: ok {rc=0} 05:54:45.956778 --- ParallelTerminationStrategy: PID 31750 died... 05:54:45.977397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31750): Terminated: ok {rc=0} 05:54:46.025764 --- ParallelTerminationStrategy: PID 31753 died... 05:54:46.047181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31753): Terminated: ok {rc=0} 05:54:46.138223 bus /gobi_0: Setting Powered False 05:54:47.253318 bus /gobi_0: Setting Powered False 05:54:48.371126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 05:54:49.516538 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:49.528636 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:49.584231 tst iperf3.py: using LAC 19388 05:54:49.706735 tst iperf3.py: using RAC 8 05:54:49.829299 tst iperf3.py: using CellId 19388 05:54:49.950586 tst iperf3.py: using BVCI 19389 05:54:50.065256 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.076497 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.087728 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.099134 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.110394 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.121643 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.133147 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.144293 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:50.155713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:50.272230 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:54:50.481260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:54:50.792065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Launched 05:54:51.062252 run iperf3-srv_10.42.42.10(pid=31756): Launched 05:54:51.178464 tst iperf3.py:8: start network... 05:54:51.385845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:54:51.864216 run create_hlr_db(pid=31757): Launched 05:54:51.982457 bus /gobi_6: Setting Powered False 05:54:53.043924 run create_hlr_db(pid=31757): Terminated: ok {rc=0} 05:54:53.495796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31759): Launched 05:54:53.826982 run osmo-hlr_10.42.42.2(pid=31760): Launched 05:54:53.952786 run osmo-stp_10.42.42.5: Starting osmo-stp 05:54:54.521635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31762): Launched 05:54:54.853627 run osmo-stp_10.42.42.5(pid=31763): Launched 05:54:54.979634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:54:55.551444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31765): Launched 05:54:55.678373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:54:55.958944 run patchelf(pid=31766): Launched 05:54:56.143386 run osmo-stp_10.42.42.5(pid=31763): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31763)] 05:54:56.283604 run osmo-stp_10.42.42.5(pid=31763): stdout: | (launched: 2022-12-09_05:54:54.792511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:56.424386 run osmo-stp_10.42.42.5(pid=31763): stderr: | 20221209055454986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055454986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055454986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055454987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055454990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055454990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055454990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:56.565961 run osmo-stp_10.42.42.5(pid=31763): stdout: | (launched: 2022-12-09_05:54:54.792511) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:54:56.702401 run osmo-stp_10.42.42.5(pid=31763): stderr: | 20221209055454986 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055454986 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055454986 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055454987 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055454990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055454990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055454990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:54:56.864087 run patchelf(pid=31766): Terminating (SIGINT) 05:54:57.049520 run patchelf(pid=31766): Terminated: ok {rc=0} 05:54:57.182859 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31763): Process ended prematurely: osmo-stp_10.42.42.5(pid=31763) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31763)] [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 05:54:57.192914 tst iperf3.py:8: Test FAILED (7.7 sec) 05:54:57.221618 run osmo-hlr_10.42.42.2(pid=31760): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31760)] 05:54:57.272069 run osmo-hlr_10.42.42.2(pid=31760): stdout: | (launched: 2022-12-09_05:54:53.766045) 05:54:57.324226 run osmo-hlr_10.42.42.2(pid=31760): stderr: | 20221209055453967 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055453967 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055453967 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055453967 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055453968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055453968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055453980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055453988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055453989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055453989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:54:57.376625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminating (SIGTERM) 05:54:57.418910 run iperf3-srv_10.42.42.10(pid=31756): Terminating (SIGTERM) 05:54:57.460803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31759): Terminating (SIGTERM) 05:54:57.502902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31762): Terminating (SIGTERM) 05:54:57.545173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31765): Terminating (SIGTERM) 05:54:57.587369 --- ParallelTerminationStrategy: PID 31755 died... 05:54:57.607480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminated: ok {rc=0} 05:54:57.653802 --- ParallelTerminationStrategy: PID 31756 died... 05:54:57.673367 run iperf3-srv_10.42.42.10(pid=31756): Terminated {rc=256} 05:54:57.719362 --- ParallelTerminationStrategy: PID 31759 died... 05:54:57.738918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31759): Terminated: ok {rc=0} 05:54:57.785396 --- ParallelTerminationStrategy: PID 31762 died... 05:54:57.805108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31762): Terminated: ok {rc=0} 05:54:57.851306 --- ParallelTerminationStrategy: PID 31765 died... 05:54:57.870901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31765): Terminated: ok {rc=0} 05:54:57.959188 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 05:54:59.111943 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.124728 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:54:59.179676 tst iperf3m4.py: using LAC 19389 05:54:59.308901 tst iperf3m4.py: using RAC 9 05:54:59.440800 tst iperf3m4.py: using CellId 19389 05:54:59.570890 tst iperf3m4.py: using BVCI 19390 05:54:59.693622 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.705541 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.717139 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.728754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.740377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.752092 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.763931 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.775460 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:54:59.787596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:54:59.907250 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:00.026566 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:00.143904 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:00.261801 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:55:00.486925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:00.821471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31767): Launched 05:55:01.170665 run iperf3-srv_10.42.42.10(pid=31771): Launched 05:55:01.311053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:55:01.542373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:01.885489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31772): Launched 05:55:02.201640 run iperf3-srv_10.42.42.10(pid=31773): Launched 05:55:02.326552 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:55:02.551245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:02.885936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31774): Launched 05:55:03.174332 run iperf3-srv_10.42.42.10(pid=31775): Launched 05:55:03.298664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:55:03.521940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:55:03.855490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Launched 05:55:04.144064 run iperf3-srv_10.42.42.10(pid=31777): Launched 05:55:04.269617 tst iperf3m4.py:8: start network... 05:55:04.493143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:05.008242 run create_hlr_db(pid=31778): Launched 05:55:05.142302 bus /gobi_6: Setting Powered False 05:55:06.207982 run create_hlr_db(pid=31778): Terminated: ok {rc=0} 05:55:06.667490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31780): Launched 05:55:06.977110 run osmo-hlr_10.42.42.2(pid=31781): Launched 05:55:07.095450 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:07.637681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31783): Launched 05:55:07.948215 run osmo-stp_10.42.42.5(pid=31784): Launched 05:55:08.067166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:08.601812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31786): Launched 05:55:08.719835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:08.980421 run patchelf(pid=31787): Launched 05:55:09.151989 run osmo-stp_10.42.42.5(pid=31784): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31784)] 05:55:09.282418 run osmo-stp_10.42.42.5(pid=31784): stdout: | (launched: 2022-12-09_05:55:07.891089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:09.413841 run osmo-stp_10.42.42.5(pid=31784): stderr: | 20221209055508065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055508065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055508065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055508066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055508066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055508066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055508066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:09.545617 run osmo-stp_10.42.42.5(pid=31784): stdout: | (launched: 2022-12-09_05:55:07.891089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:09.672566 run osmo-stp_10.42.42.5(pid=31784): stderr: | 20221209055508065 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055508065 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055508065 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055508066 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055508066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055508066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055508066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:09.823437 run patchelf(pid=31787): Terminating (SIGINT) 05:55:09.996340 run patchelf(pid=31787): Terminated: ok {rc=0} 05:55:10.121490 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31784): Process ended prematurely: osmo-stp_10.42.42.5(pid=31784) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31784)] [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 05:55:10.131043 tst iperf3m4.py:8: Test FAILED (11.1 sec) 05:55:10.158777 run osmo-hlr_10.42.42.2(pid=31781): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31781)] 05:55:10.207488 run osmo-hlr_10.42.42.2(pid=31781): stdout: | (launched: 2022-12-09_05:55:06.919953) 05:55:10.257491 run osmo-hlr_10.42.42.2(pid=31781): stderr: | 20221209055507099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055507099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055507099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055507099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055507099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055507099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055507111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055507120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055507120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055507120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:10.307721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31767): Terminating (SIGTERM) 05:55:10.348190 run iperf3-srv_10.42.42.10(pid=31771): Terminating (SIGTERM) 05:55:10.388562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31772): Terminating (SIGTERM) 05:55:10.429427 run iperf3-srv_10.42.42.10(pid=31773): Terminating (SIGTERM) 05:55:10.469799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31774): Terminating (SIGTERM) 05:55:10.509993 run iperf3-srv_10.42.42.10(pid=31775): Terminating (SIGTERM) 05:55:10.550373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Terminating (SIGTERM) 05:55:10.590758 run iperf3-srv_10.42.42.10(pid=31777): Terminating (SIGTERM) 05:55:10.630863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31780): Terminating (SIGTERM) 05:55:10.671281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31783): Terminating (SIGTERM) 05:55:10.711607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31786): Terminating (SIGTERM) 05:55:10.752215 --- ParallelTerminationStrategy: PID 31767 died... 05:55:10.771463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31767): Terminated: ok {rc=0} 05:55:10.816389 --- ParallelTerminationStrategy: PID 31771 died... 05:55:10.835272 run iperf3-srv_10.42.42.10(pid=31771): Terminated {rc=256} 05:55:10.879846 --- ParallelTerminationStrategy: PID 31772 died... 05:55:10.898594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31772): Terminated: ok {rc=0} 05:55:10.943213 --- ParallelTerminationStrategy: PID 31773 died... 05:55:10.961890 run iperf3-srv_10.42.42.10(pid=31773): Terminated {rc=256} 05:55:11.006350 --- ParallelTerminationStrategy: PID 31774 died... 05:55:11.025118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31774): Terminated: ok {rc=0} 05:55:11.069476 --- ParallelTerminationStrategy: PID 31775 died... 05:55:11.088007 run iperf3-srv_10.42.42.10(pid=31775): Terminated {rc=256} 05:55:11.133105 --- ParallelTerminationStrategy: PID 31776 died... 05:55:11.151781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Terminated: ok {rc=0} 05:55:11.196334 --- ParallelTerminationStrategy: PID 31777 died... 05:55:11.214897 run iperf3-srv_10.42.42.10(pid=31777): Terminated {rc=256} 05:55:11.259115 --- ParallelTerminationStrategy: PID 31780 died... 05:55:11.277894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31780): Terminated: ok {rc=0} 05:55:11.322410 --- ParallelTerminationStrategy: PID 31783 died... 05:55:11.341062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31783): Terminated: ok {rc=0} 05:55:11.385201 --- ParallelTerminationStrategy: PID 31786 died... 05:55:11.403680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31786): Terminated: ok {rc=0} 05:55:11.490692 bus /gobi_4: Setting Powered False 05:55:12.589964 bus /gobi_4: Setting Powered False 05:55:13.705916 bus /gobi_1: Setting Powered False 05:55:14.804214 bus /gobi_1: Setting Powered False 05:55:15.924692 bus /gobi_0: Setting Powered False 05:55:17.024088 bus /gobi_0: Setting Powered False 05:55:18.143441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 05:55:19.246798 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.258976 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:19.312518 tst ping.py: using LAC 19390 05:55:19.433092 tst ping.py: using RAC 10 05:55:19.552593 tst ping.py: using CellId 19390 05:55:19.670257 tst ping.py: using BVCI 19391 05:55:19.782074 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.793656 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.805263 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.816723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.828234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.839762 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.851344 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:19.862906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:19.979237 tst ping.py:19: start network... 05:55:20.183294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:20.654354 run create_hlr_db(pid=31788): Launched 05:55:20.769471 bus /gobi_6: Setting Powered False 05:55:21.830297 run create_hlr_db(pid=31788): Terminated: ok {rc=0} 05:55:22.275656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31790): Launched 05:55:22.601846 run osmo-hlr_10.42.42.2(pid=31791): Launched 05:55:22.725596 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:23.290983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31793): Launched 05:55:23.616778 run osmo-stp_10.42.42.5(pid=31794): Launched 05:55:23.740392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:24.303225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Launched 05:55:24.427850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:24.703316 run patchelf(pid=31797): Launched 05:55:24.885258 run osmo-stp_10.42.42.5(pid=31794): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31794)] 05:55:25.023110 run osmo-stp_10.42.42.5(pid=31794): stdout: | (launched: 2022-12-09_05:55:23.556876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:25.162757 run osmo-stp_10.42.42.5(pid=31794): stderr: | 20221209055523752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055523752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055523753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055523753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055523753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055523753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055523754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:25.302290 run osmo-stp_10.42.42.5(pid=31794): stdout: | (launched: 2022-12-09_05:55:23.556876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:25.435699 run osmo-stp_10.42.42.5(pid=31794): stderr: | 20221209055523752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055523752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055523753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055523753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055523753 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055523753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055523754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:25.593679 run patchelf(pid=31797): Terminating (SIGINT) 05:55:25.776360 run patchelf(pid=31797): Terminated: ok {rc=0} 05:55:25.908570 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31794): Process ended prematurely: osmo-stp_10.42.42.5(pid=31794) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31794)] [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 05:55:25.918228 tst ping.py:22: Test FAILED (6.7 sec) 05:55:25.946645 run osmo-hlr_10.42.42.2(pid=31791): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31791)] 05:55:25.997041 run osmo-hlr_10.42.42.2(pid=31791): stdout: | (launched: 2022-12-09_05:55:22.541925) 05:55:26.049285 run osmo-hlr_10.42.42.2(pid=31791): stderr: | 20221209055522743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055522743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055522743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055522743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055522743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055522743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055522755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055522763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055522763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055522763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:26.101748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31790): Terminating (SIGTERM) 05:55:26.143820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31793): Terminating (SIGTERM) 05:55:26.186161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Terminating (SIGTERM) 05:55:26.228558 --- ParallelTerminationStrategy: PID 31790 died... 05:55:26.248821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31790): Terminated: ok {rc=0} 05:55:26.295347 --- ParallelTerminationStrategy: PID 31793 died... 05:55:26.315350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31793): Terminated: ok {rc=0} 05:55:26.362949 --- ParallelTerminationStrategy: PID 31796 died... 05:55:26.382878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Terminated: ok {rc=0} 05:55:26.471942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 05:55:27.558558 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:27.570766 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 05:55:27.623732 tst ping_idle_ping.py: using LAC 19391 05:55:27.742764 tst ping_idle_ping.py: using RAC 11 05:55:27.862805 tst ping_idle_ping.py: using CellId 19391 05:55:27.986353 tst ping_idle_ping.py: using BVCI 19392 05:55:28.097598 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.108921 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.120154 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.131529 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.142869 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.154223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.165747 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 05:55:28.176937 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 05:55:28.292573 tst ping_idle_ping.py:24: start network... 05:55:28.498981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:28.974965 run create_hlr_db(pid=31798): Launched 05:55:29.091181 bus /gobi_6: Setting Powered False 05:55:30.152051 run create_hlr_db(pid=31798): Terminated: ok {rc=0} 05:55:30.600539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31800): Launched 05:55:30.958230 run osmo-hlr_10.42.42.2(pid=31801): Launched 05:55:31.148861 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:31.897629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31803): Launched 05:55:32.225635 run osmo-stp_10.42.42.5(pid=31804): Launched 05:55:32.344419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:32.875109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31806): Launched 05:55:32.991678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:33.248741 run patchelf(pid=31807): Launched 05:55:33.418719 run osmo-stp_10.42.42.5(pid=31804): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31804)] 05:55:33.547949 run osmo-stp_10.42.42.5(pid=31804): stdout: | (launched: 2022-12-09_05:55:32.160460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:33.678606 run osmo-stp_10.42.42.5(pid=31804): stderr: | 20221209055532343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055532343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055532343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055532344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055532344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055532344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055532344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:33.809183 run osmo-stp_10.42.42.5(pid=31804): stdout: | (launched: 2022-12-09_05:55:32.160460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:33.934108 run osmo-stp_10.42.42.5(pid=31804): stderr: | 20221209055532343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055532343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055532343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055532344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055532344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055532344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055532344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:34.081482 run patchelf(pid=31807): Terminating (SIGINT) 05:55:34.252098 run patchelf(pid=31807): Terminated: ok {rc=0} 05:55:34.375300 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31804): Process ended prematurely: osmo-stp_10.42.42.5(pid=31804) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31804)] [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 05:55:34.384559 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 05:55:34.411741 run osmo-hlr_10.42.42.2(pid=31801): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31801)] 05:55:34.460315 run osmo-hlr_10.42.42.2(pid=31801): stdout: | (launched: 2022-12-09_05:55:30.878229) 05:55:34.510471 run osmo-hlr_10.42.42.2(pid=31801): stderr: | 20221209055531213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055531213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055531213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055531213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055531213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055531213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055531229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055531246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055531246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055531246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:34.560900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31800): Terminating (SIGTERM) 05:55:34.601484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31803): Terminating (SIGTERM) 05:55:34.641860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31806): Terminating (SIGTERM) 05:55:34.682502 --- ParallelTerminationStrategy: PID 31800 died... 05:55:34.701825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31800): Terminated: ok {rc=0} 05:55:34.746789 --- ParallelTerminationStrategy: PID 31803 died... 05:55:34.765771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31803): Terminated: ok {rc=0} 05:55:34.810510 --- ParallelTerminationStrategy: PID 31806 died... 05:55:34.829550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31806): Terminated: ok {rc=0} 05:55:34.918400 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:55:36.227880 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:36.234960 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:55:36.269085 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 05:55:36.303368 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:55:36.355893 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:55:36.389202 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 05:55:36.423913 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:55:36.981440 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 05:55:36.986452 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:36.997768 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:55:37.069886 tst switch_tch_pdch.py: using LAC 19392 05:55:37.187530 tst switch_tch_pdch.py: using RAC 12 05:55:37.303962 tst switch_tch_pdch.py: using CellId 19392 05:55:37.420870 tst switch_tch_pdch.py: using BVCI 19393 05:55:37.539702 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.551448 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.563086 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.574687 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.586296 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.597774 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.609582 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 05:55:37.621152 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:55:37.737490 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:55:37.858050 tst switch_tch_pdch.py:51: start network... 05:55:38.078563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:38.583605 run create_hlr_db(pid=31813): Launched 05:55:38.715060 bus /gobi_6: Setting Powered False 05:55:39.779666 run create_hlr_db(pid=31813): Terminated: ok {rc=0} 05:55:40.235222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Launched 05:55:40.562056 run osmo-hlr_10.42.42.2(pid=31816): Launched 05:55:40.685679 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:41.244709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Launched 05:55:41.569383 run osmo-stp_10.42.42.5(pid=31819): Launched 05:55:41.693368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:42.280852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Launched 05:55:42.404907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:42.679891 run patchelf(pid=31822): Launched 05:55:42.861304 run osmo-stp_10.42.42.5(pid=31819): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] 05:55:42.999655 run osmo-stp_10.42.42.5(pid=31819): stdout: | (launched: 2022-12-09_05:55:41.509515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:43.139218 run osmo-stp_10.42.42.5(pid=31819): stderr: | 20221209055541703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055541704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055541704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055541705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055541705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055541705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055541705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:43.278846 run osmo-stp_10.42.42.5(pid=31819): stdout: | (launched: 2022-12-09_05:55:41.509515) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:43.411767 run osmo-stp_10.42.42.5(pid=31819): stderr: | 20221209055541703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055541704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055541704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055541705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055541705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055541705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055541705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:43.570054 run patchelf(pid=31822): Terminating (SIGINT) 05:55:43.751984 run patchelf(pid=31822): Terminated: ok {rc=0} 05:55:43.883959 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31819): Process ended prematurely: osmo-stp_10.42.42.5(pid=31819) [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 05:55:43.893451 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 05:55:43.921662 run osmo-hlr_10.42.42.2(pid=31816): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31816)] 05:55:43.972129 run osmo-hlr_10.42.42.2(pid=31816): stdout: | (launched: 2022-12-09_05:55:40.501988) 05:55:44.024464 run osmo-hlr_10.42.42.2(pid=31816): stderr: | 20221209055540701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055540701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055540701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055540701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055540701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055540701 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055540714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055540722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055540722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055540722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:44.077271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Terminating (SIGTERM) 05:55:44.119576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Terminating (SIGTERM) 05:55:44.161887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Terminating (SIGTERM) 05:55:44.204459 --- ParallelTerminationStrategy: PID 31815 died... 05:55:44.224859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Terminated: ok {rc=0} 05:55:44.271495 --- ParallelTerminationStrategy: PID 31818 died... 05:55:44.291173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Terminated: ok {rc=0} 05:55:44.337476 --- ParallelTerminationStrategy: PID 31821 died... 05:55:44.357179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Terminated: ok {rc=0} 05:55:44.445326 bus /gobi_0: Setting Powered False 05:55:45.546128 bus /gobi_0: Setting Powered False 05:55:46.663512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 05:55:47.921782 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:47.928128 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 05:55:47.962411 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 05:55:47.997817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 05:55:48.059796 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 05:55:48.093837 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 05:55:48.129144 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 05:55:48.685264 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 05:55:48.690786 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:48.704171 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 05:55:48.783678 tst switch_tch_pdch.py: using LAC 19393 05:55:48.910833 tst switch_tch_pdch.py: using RAC 13 05:55:49.030246 tst switch_tch_pdch.py: using CellId 19393 05:55:49.150044 tst switch_tch_pdch.py: using BVCI 19394 05:55:49.261693 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.272809 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.283655 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.294882 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.306182 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.317525 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.328797 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 05:55:49.340026 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:55:49.459857 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 05:55:49.577576 tst switch_tch_pdch.py:51: start network... 05:55:49.782719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:55:50.227380 run create_hlr_db(pid=31826): Launched 05:55:50.343233 bus /gobi_6: Setting Powered False 05:55:51.403553 run create_hlr_db(pid=31826): Terminated: ok {rc=0} 05:55:51.803198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Launched 05:55:52.106736 run osmo-hlr_10.42.42.2(pid=31829): Launched 05:55:52.222157 run osmo-stp_10.42.42.5: Starting osmo-stp 05:55:52.718991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Launched 05:55:53.023260 run osmo-stp_10.42.42.5(pid=31832): Launched 05:55:53.138312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:55:53.634949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31834): Launched 05:55:53.751342 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:55:54.008145 run patchelf(pid=31835): Launched 05:55:54.177761 run osmo-stp_10.42.42.5(pid=31832): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] 05:55:54.306523 run osmo-stp_10.42.42.5(pid=31832): stdout: | (launched: 2022-12-09_05:55:52.966590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:54.436660 run osmo-stp_10.42.42.5(pid=31832): stderr: | 20221209055553139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055553139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055553139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055553140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055553140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055553140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055553140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:54.567497 run osmo-stp_10.42.42.5(pid=31832): stdout: | (launched: 2022-12-09_05:55:52.966590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:55:54.691642 run osmo-stp_10.42.42.5(pid=31832): stderr: | 20221209055553139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055553139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055553139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055553140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055553140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055553140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055553140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:55:54.839619 run patchelf(pid=31835): Terminating (SIGINT) 05:55:55.009289 run patchelf(pid=31835): Terminated: ok {rc=0} 05:55:55.132114 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31832): Process ended prematurely: osmo-stp_10.42.42.5(pid=31832) [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 05:55:55.141090 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 05:55:55.168168 run osmo-hlr_10.42.42.2(pid=31829): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31829)] 05:55:55.217035 run osmo-hlr_10.42.42.2(pid=31829): stdout: | (launched: 2022-12-09_05:55:52.050767) 05:55:55.267755 run osmo-hlr_10.42.42.2(pid=31829): stderr: | 20221209055552229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055552229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055552229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055552230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055552230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055552230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055552246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055552256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055552256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055552256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:55:55.318725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Terminating (SIGTERM) 05:55:55.359675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Terminating (SIGTERM) 05:55:55.400486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31834): Terminating (SIGTERM) 05:55:55.441483 --- ParallelTerminationStrategy: PID 31828 died... 05:55:55.461065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31828): Terminated: ok {rc=0} 05:55:55.506629 --- ParallelTerminationStrategy: PID 31831 died... 05:55:55.525688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31831): Terminated: ok {rc=0} 05:55:55.570719 --- ParallelTerminationStrategy: PID 31834 died... 05:55:55.589832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31834): Terminated: ok {rc=0} 05:55:55.677586 bus /gobi_0: Setting Powered False 05:55:56.778645 bus /gobi_0: Setting Powered False 05:55:57.892885 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:55:59.156005 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:55:59.160607 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:55:59.195262 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:55:59.202220 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:55:59.254651 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:55:59.287776 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:55:59.294396 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:55:59.835309 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:55:59.840363 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:55:59.851698 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:55:59.901463 tst mo_mt_sms.py: using LAC 19394 05:56:00.024355 tst mo_mt_sms.py: using RAC 14 05:56:00.146868 tst mo_mt_sms.py: using CellId 19394 05:56:00.270462 tst mo_mt_sms.py: using BVCI 19395 05:56:00.385213 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:00.498381 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:00.615871 tst mo_mt_sms.py:9: start nitb and bts... 05:56:00.837727 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:56:01.497770 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31839): Launched 05:56:01.838340 run osmo-nitb_10.42.42.2(pid=31840): Launched 05:56:02.031604 run osmo-nitb_10.42.42.2(pid=31840): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31840)] 05:56:02.176404 run osmo-nitb_10.42.42.2(pid=31840): stdout: | (launched: 2022-12-09_05:56:01.773781) 05:56:02.321381 run osmo-nitb_10.42.42.2(pid=31840): stderr: | (launched: 2022-12-09_05:56:01.823279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:02.466126 run osmo-nitb_10.42.42.2(pid=31840): stdout: | (launched: 2022-12-09_05:56:01.773781) 05:56:02.605708 run osmo-nitb_10.42.42.2(pid=31840): stderr: | (launched: 2022-12-09_05:56:01.823279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31840): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31840) [trial-2355↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31840)] 05:56:02.974331 tst osmo-nitb_10.42.42.2(pid=31840): stdout: | (launched: 2022-12-09_05:56:01.773781) 05:56:03.103140 tst osmo-nitb_10.42.42.2(pid=31840): stderr: | (launched: 2022-12-09_05:56:01.823279) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:03.254825 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31840): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31840) [trial-2355↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31840)] [trial-2355↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 05:56:03.263606 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 05:56:03.270547 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31839): Terminating (SIGTERM) 05:56:03.483226 --- ParallelTerminationStrategy: PID 31839 died... 05:56:03.504942 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31839): Terminated: ok {rc=0} 05:56:03.594810 bus /sierra_3: Setting Powered False 05:56:04.695568 bus /sierra_3: Setting Powered False 05:56:05.816420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:07.020147 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:07.024308 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:07.058618 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:56:07.085783 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 05:56:07.139689 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:07.173959 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:56:07.200830 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 05:56:07.748281 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 05:56:07.753417 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:07.764346 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:07.813496 tst mo_mt_sms.py: using LAC 19395 05:56:07.932441 tst mo_mt_sms.py: using RAC 15 05:56:08.047640 tst mo_mt_sms.py: using CellId 19395 05:56:08.165127 tst mo_mt_sms.py: using BVCI 19396 05:56:08.271912 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:08.282543 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:08.293053 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:08.303698 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:08.314351 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:08.325018 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:08.444119 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 05:56:08.563699 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:09.057971 run create_hlr_db(pid=31845): Launched 05:56:09.187909 bus /sierra_2: Setting Powered False 05:56:10.251087 run create_hlr_db(pid=31845): Terminated: ok {rc=0} 05:56:10.677959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31847): Launched 05:56:10.975905 run osmo-hlr_10.42.42.2(pid=31848): Launched 05:56:11.088017 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:11.637314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31850): Launched 05:56:11.956803 run osmo-stp_10.42.42.5(pid=31851): Launched 05:56:12.077511 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:12.653111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31853): Launched 05:56:12.972737 run osmo-msc_10.42.42.6(pid=31854): Launched 05:56:13.148643 run osmo-stp_10.42.42.5(pid=31851): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31851)] 05:56:13.282802 run osmo-stp_10.42.42.5(pid=31851): stdout: | (launched: 2022-12-09_05:56:11.898649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:13.417555 run osmo-stp_10.42.42.5(pid=31851): stderr: | 20221209055612091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055612091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055612092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055612092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055612092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055612093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055612093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:13.551626 run osmo-stp_10.42.42.5(pid=31851): stdout: | (launched: 2022-12-09_05:56:11.898649) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:13.678368 run osmo-stp_10.42.42.5(pid=31851): stderr: | 20221209055612091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055612091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055612092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055612092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055612092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055612093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055612093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:13.830436 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31851): Process ended prematurely: osmo-stp_10.42.42.5(pid=31851) [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31851)] [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 05:56:13.839196 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 05:56:13.866518 run osmo-hlr_10.42.42.2(pid=31848): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31848)] 05:56:13.916537 run osmo-hlr_10.42.42.2(pid=31848): stdout: | (launched: 2022-12-09_05:56:10.921103) 05:56:13.968385 run osmo-hlr_10.42.42.2(pid=31848): stderr: | 20221209055611095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055611095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055611095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055611095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055611095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055611095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055611107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055611116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055611116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055611116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:14.040775 run osmo-msc_10.42.42.6(pid=31854): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31854)] 05:56:14.090744 run osmo-msc_10.42.42.6(pid=31854): stdout: | (launched: 2022-12-09_05:56:12.914234) 05:56:14.142785 run osmo-msc_10.42.42.6(pid=31854): stderr: | 20221209055613238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055613239 DLGLOBAL DEBUG validating counter group 0x7f7340ac8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055613239 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055613239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055613239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055613239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055613241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055613241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055613241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055613242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:14.195308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31847): Terminating (SIGTERM) 05:56:14.237034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31850): Terminating (SIGTERM) 05:56:14.278694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31853): Terminating (SIGTERM) 05:56:14.320681 --- ParallelTerminationStrategy: PID 31847 died... 05:56:14.340242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31847): Terminated: ok {rc=0} 05:56:14.386545 --- ParallelTerminationStrategy: PID 31850 died... 05:56:14.406059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31850): Terminated: ok {rc=0} 05:56:14.451859 --- ParallelTerminationStrategy: PID 31853 died... 05:56:14.471336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31853): Terminated: ok {rc=0} 05:56:14.559159 bus /sierra_3: Setting Powered False 05:56:15.658460 bus /sierra_3: Setting Powered False 05:56:16.784608 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:18.017482 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:18.023195 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:18.058432 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 05:56:18.065264 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:56:18.102650 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:18.137581 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 05:56:18.144625 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:56:18.661800 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:56:18.667130 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 05:56:18.678662 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:18.728659 tst assert_extension.py: using LAC 19396 05:56:18.855417 tst assert_extension.py: using RAC 16 05:56:18.973386 tst assert_extension.py: using CellId 19396 05:56:19.090193 tst assert_extension.py: using BVCI 19397 05:56:19.197154 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:56:19.309250 tst assert_extension.py:10: start nitb and bts... 05:56:19.507091 run osmo-nitb_10.42.42.2: Starting osmo-nitb 05:56:20.111997 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31859): Launched 05:56:20.408499 run osmo-nitb_10.42.42.2(pid=31860): Launched 05:56:20.572920 run osmo-nitb_10.42.42.2(pid=31860): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31860)] 05:56:20.706692 run osmo-nitb_10.42.42.2(pid=31860): stdout: | (launched: 2022-12-09_05:56:20.353790) 05:56:20.843372 run osmo-nitb_10.42.42.2(pid=31860): stderr: | (launched: 2022-12-09_05:56:20.397810) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:20.978818 run osmo-nitb_10.42.42.2(pid=31860): stdout: | (launched: 2022-12-09_05:56:20.353790) 05:56:21.108541 run osmo-nitb_10.42.42.2(pid=31860): stderr: | (launched: 2022-12-09_05:56:20.397810) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31860) [trial-2355↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31860)] 05:56:21.520235 tst osmo-nitb_10.42.42.2(pid=31860): stdout: | (launched: 2022-12-09_05:56:20.353790) 05:56:21.641264 tst osmo-nitb_10.42.42.2(pid=31860): stderr: | (launched: 2022-12-09_05:56:20.397810) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 05:56:21.782818 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31860) [trial-2355↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31860)] [trial-2355↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 05:56:21.790994 tst assert_extension.py:12: Test FAILED (3.1 sec) 05:56:21.797511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31859): Terminating (SIGTERM) 05:56:22.008910 --- ParallelTerminationStrategy: PID 31859 died... 05:56:22.029564 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31859): Terminated: ok {rc=0} 05:56:22.117969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 05:56:23.299294 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:23.303574 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:56:23.338312 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:56:23.365679 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 05:56:23.403573 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:56:23.437590 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:56:23.464475 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 05:56:23.996726 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 05:56:24.002910 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.014639 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:56:24.065716 tst assert_extension.py: using LAC 19397 05:56:24.183314 tst assert_extension.py: using RAC 17 05:56:24.300624 tst assert_extension.py: using CellId 19397 05:56:24.417555 tst assert_extension.py: using BVCI 19398 05:56:24.533651 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.544893 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.556135 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.567324 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.578450 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:56:24.589793 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 05:56:24.702600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:25.161164 run create_hlr_db(pid=31864): Launched 05:56:25.274919 bus /sierra_2: Setting Powered False 05:56:26.335083 run create_hlr_db(pid=31864): Terminated: ok {rc=0} 05:56:26.749703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Launched 05:56:27.047322 run osmo-hlr_10.42.42.2(pid=31867): Launched 05:56:27.159982 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:27.770490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Launched 05:56:28.064276 run osmo-stp_10.42.42.5(pid=31870): Launched 05:56:28.176717 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:28.701070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31872): Launched 05:56:28.990698 run osmo-msc_10.42.42.6(pid=31873): Launched 05:56:29.152209 run osmo-stp_10.42.42.5(pid=31870): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] 05:56:29.275884 run osmo-stp_10.42.42.5(pid=31870): stdout: | (launched: 2022-12-09_05:56:28.011475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:29.399757 run osmo-stp_10.42.42.5(pid=31870): stderr: | 20221209055628177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055628177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055628177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055628178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055628180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055628180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055628180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:29.521459 run osmo-stp_10.42.42.5(pid=31870): stdout: | (launched: 2022-12-09_05:56:28.011475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:29.637125 run osmo-stp_10.42.42.5(pid=31870): stderr: | 20221209055628177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055628177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055628177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055628178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055628180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055628180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055628180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:29.775410 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31870): Process ended prematurely: osmo-stp_10.42.42.5(pid=31870) [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py:17] 05:56:29.783566 tst assert_extension.py:17: Test FAILED (5.8 sec) 05:56:29.809674 run osmo-hlr_10.42.42.2(pid=31867): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31867)] 05:56:29.857806 run osmo-hlr_10.42.42.2(pid=31867): stdout: | (launched: 2022-12-09_05:56:26.992817) 05:56:29.907218 run osmo-hlr_10.42.42.2(pid=31867): stderr: | 20221209055627169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055627169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055627169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055627169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055627169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055627169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055627181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055627191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055627192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055627192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:29.976146 run osmo-msc_10.42.42.6(pid=31873): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31873)] 05:56:30.024005 run osmo-msc_10.42.42.6(pid=31873): stdout: | (launched: 2022-12-09_05:56:28.937976) 05:56:30.073518 run osmo-msc_10.42.42.6(pid=31873): stderr: | 20221209055629206 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055629207 DLGLOBAL DEBUG validating counter group 0x7fa9b9d1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055629207 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055629207 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055629207 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055629207 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055629209 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055629209 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055629209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055629210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:30.123690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Terminating (SIGTERM) 05:56:30.163754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Terminating (SIGTERM) 05:56:30.204061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31872): Terminating (SIGTERM) 05:56:30.244250 --- ParallelTerminationStrategy: PID 31866 died... 05:56:30.263342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31866): Terminated: ok {rc=0} 05:56:30.307723 --- ParallelTerminationStrategy: PID 31869 died... 05:56:30.326093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31869): Terminated: ok {rc=0} 05:56:30.370032 --- ParallelTerminationStrategy: PID 31872 died... 05:56:30.388395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31872): Terminated: ok {rc=0} 05:56:30.474660 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 05:56:31.696193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:31.708215 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 05:56:31.752059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 05:56:31.788795 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 05:56:31.852310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 05:56:31.902247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 05:56:31.937408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 05:56:32.467953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 05:56:32.521577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:32.533319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:56:32.605447 tst mo_mt_call.py: using LAC 19398 05:56:32.724356 tst mo_mt_call.py: using RAC 18 05:56:32.845092 tst mo_mt_call.py: using CellId 19398 05:56:32.961553 tst mo_mt_call.py: using BVCI 19399 05:56:33.078925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:33.090684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:33.102146 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:33.114328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:33.126503 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:33.138425 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:33.254967 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:33.374578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:33.868769 run create_hlr_db(pid=31878): Launched 05:56:33.999143 bus /sierra_2: Setting Powered False 05:56:35.062351 run create_hlr_db(pid=31878): Terminated: ok {rc=0} 05:56:35.487436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31880): Launched 05:56:35.784559 run osmo-hlr_10.42.42.2(pid=31881): Launched 05:56:35.897959 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:36.423007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31883): Launched 05:56:36.719297 run osmo-stp_10.42.42.5(pid=31884): Launched 05:56:36.831428 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:37.368663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31886): Launched 05:56:37.666039 run osmo-msc_10.42.42.6(pid=31887): Launched 05:56:37.831258 run osmo-stp_10.42.42.5(pid=31884): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31884)] 05:56:37.958184 run osmo-stp_10.42.42.5(pid=31884): stdout: | (launched: 2022-12-09_05:56:36.665330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:38.088444 run osmo-stp_10.42.42.5(pid=31884): stderr: | 20221209055636837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055636837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055636837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055636838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055636838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055636838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055636838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:38.211889 run osmo-stp_10.42.42.5(pid=31884): stdout: | (launched: 2022-12-09_05:56:36.665330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:38.329494 run osmo-stp_10.42.42.5(pid=31884): stderr: | 20221209055636837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055636837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055636837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055636838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055636838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055636838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055636838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:38.470005 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31884): Process ended prematurely: osmo-stp_10.42.42.5(pid=31884) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31884)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 05:56:38.478720 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 05:56:38.505583 run osmo-hlr_10.42.42.2(pid=31881): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31881)] 05:56:38.554083 run osmo-hlr_10.42.42.2(pid=31881): stdout: | (launched: 2022-12-09_05:56:35.729941) 05:56:38.604178 run osmo-hlr_10.42.42.2(pid=31881): stderr: | 20221209055635906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055635906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055635906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055635906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055635906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055635906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055635918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055635929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055635929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055635929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:38.673566 run osmo-msc_10.42.42.6(pid=31887): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31887)] 05:56:38.721822 run osmo-msc_10.42.42.6(pid=31887): stdout: | (launched: 2022-12-09_05:56:37.611502) 05:56:38.771672 run osmo-msc_10.42.42.6(pid=31887): stderr: | 20221209055637883 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055637883 DLGLOBAL DEBUG validating counter group 0x7fbf68150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055637883 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055637883 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055637883 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055637884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055637886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055637886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055637886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055637886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:38.822087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31880): Terminating (SIGTERM) 05:56:38.862388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31883): Terminating (SIGTERM) 05:56:38.903273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31886): Terminating (SIGTERM) 05:56:38.943751 --- ParallelTerminationStrategy: PID 31880 died... 05:56:38.962816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31880): Terminated: ok {rc=0} 05:56:39.007348 --- ParallelTerminationStrategy: PID 31883 died... 05:56:39.025983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31883): Terminated: ok {rc=0} 05:56:39.070265 --- ParallelTerminationStrategy: PID 31886 died... 05:56:39.088741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31886): Terminated: ok {rc=0} 05:56:39.175714 bus /sierra_3: Setting Powered False 05:56:40.275204 bus /sierra_3: Setting Powered False 05:56:41.391458 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 05:56:42.540523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:42.552824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 05:56:42.631775 tst mo_mt_call_osmux.py: using LAC 19399 05:56:42.757131 tst mo_mt_call_osmux.py: using RAC 19 05:56:42.881396 tst mo_mt_call_osmux.py: using CellId 19399 05:56:43.006786 tst mo_mt_call_osmux.py: using BVCI 19400 05:56:43.122445 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:43.134291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:43.146000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:43.157652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:43.169381 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 05:56:43.180897 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:43.295647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 05:56:43.415622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:43.910604 run create_hlr_db(pid=31889): Launched 05:56:44.040068 bus /sierra_2: Setting Powered False 05:56:45.104034 run create_hlr_db(pid=31889): Terminated: ok {rc=0} 05:56:45.548090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31891): Launched 05:56:45.873649 run osmo-hlr_10.42.42.2(pid=31892): Launched 05:56:46.091519 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:46.740350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31894): Launched 05:56:47.079336 run osmo-stp_10.42.42.5(pid=31895): Launched 05:56:47.295192 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:47.898451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31897): Launched 05:56:48.216203 run osmo-msc_10.42.42.6(pid=31898): Launched 05:56:48.393917 run osmo-stp_10.42.42.5(pid=31895): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31895)] 05:56:48.528283 run osmo-stp_10.42.42.5(pid=31895): stdout: | (launched: 2022-12-09_05:56:47.012761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:48.663012 run osmo-stp_10.42.42.5(pid=31895): stderr: | 20221209055647292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055647292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055647293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055647293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055647293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055647294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055647294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:48.797349 run osmo-stp_10.42.42.5(pid=31895): stdout: | (launched: 2022-12-09_05:56:47.012761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:48.924089 run osmo-stp_10.42.42.5(pid=31895): stderr: | 20221209055647292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055647292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055647293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055647293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055647293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055647294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055647294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:49.075822 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31895): Process ended prematurely: osmo-stp_10.42.42.5(pid=31895) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31895)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 05:56:49.085494 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:56:49.113372 run osmo-hlr_10.42.42.2(pid=31892): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31892)] 05:56:49.163539 run osmo-hlr_10.42.42.2(pid=31892): stdout: | (launched: 2022-12-09_05:56:45.808251) 05:56:49.215329 run osmo-hlr_10.42.42.2(pid=31892): stderr: | 20221209055646063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055646063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055646063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055646063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055646063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055646063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055646082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055646094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055646095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055646095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:56:49.287306 run osmo-msc_10.42.42.6(pid=31898): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31898)] 05:56:49.337565 run osmo-msc_10.42.42.6(pid=31898): stdout: | (launched: 2022-12-09_05:56:48.158560) 05:56:49.389221 run osmo-msc_10.42.42.6(pid=31898): stderr: | 20221209055648481 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055648481 DLGLOBAL DEBUG validating counter group 0x7fcd531b4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055648481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055648481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055648481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055648481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055648483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055648483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055648484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055648484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:56:49.441420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31891): Terminating (SIGTERM) 05:56:49.483082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31894): Terminating (SIGTERM) 05:56:49.524844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31897): Terminating (SIGTERM) 05:56:49.567180 --- ParallelTerminationStrategy: PID 31891 died... 05:56:49.587115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31891): Terminated: ok {rc=0} 05:56:49.633362 --- ParallelTerminationStrategy: PID 31894 died... 05:56:49.652748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31894): Terminated: ok {rc=0} 05:56:49.698540 --- ParallelTerminationStrategy: PID 31897 died... 05:56:49.718028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31897): Terminated: ok {rc=0} 05:56:49.804875 bus /sierra_3: Setting Powered False 05:56:50.903495 bus /sierra_3: Setting Powered False 05:56:52.016888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 05:56:53.270233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:56:53.277789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 05:56:53.311940 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 05:56:53.338677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 05:56:53.389466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 05:56:53.422890 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 05:56:53.448884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 05:56:54.000436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 05:56:54.048219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.059384 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:56:54.127845 tst mo_mt_call.py: using LAC 19400 05:56:54.244029 tst mo_mt_call.py: using RAC 20 05:56:54.360169 tst mo_mt_call.py: using CellId 19400 05:56:54.479782 tst mo_mt_call.py: using BVCI 19401 05:56:54.596550 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.608372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.619994 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.631828 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.643663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:56:54.655465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:54.769401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:56:54.887254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:56:55.382105 run create_hlr_db(pid=31903): Launched 05:56:55.511087 bus /sierra_2: Setting Powered False 05:56:56.574482 run create_hlr_db(pid=31903): Terminated: ok {rc=0} 05:56:56.999039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31905): Launched 05:56:57.296563 run osmo-hlr_10.42.42.2(pid=31906): Launched 05:56:57.421553 run osmo-stp_10.42.42.5: Starting osmo-stp 05:56:57.972498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31908): Launched 05:56:58.290075 run osmo-stp_10.42.42.5(pid=31909): Launched 05:56:58.410736 run osmo-msc_10.42.42.6: Starting osmo-msc 05:56:58.991308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31911): Launched 05:56:59.311025 run osmo-msc_10.42.42.6(pid=31912): Launched 05:56:59.488730 run osmo-stp_10.42.42.5(pid=31909): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31909)] 05:56:59.623290 run osmo-stp_10.42.42.5(pid=31909): stdout: | (launched: 2022-12-09_05:56:58.232721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:56:59.758032 run osmo-stp_10.42.42.5(pid=31909): stderr: | 20221209055658422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055658423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055658423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055658423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055658425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055658425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055658425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:56:59.892681 run osmo-stp_10.42.42.5(pid=31909): stdout: | (launched: 2022-12-09_05:56:58.232721) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:00.019544 run osmo-stp_10.42.42.5(pid=31909): stderr: | 20221209055658422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055658423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055658423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055658423 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055658425 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055658425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055658425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:00.171772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31909): Process ended prematurely: osmo-stp_10.42.42.5(pid=31909) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31909)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 05:57:00.181575 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:00.209515 run osmo-hlr_10.42.42.2(pid=31906): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31906)] 05:57:00.260237 run osmo-hlr_10.42.42.2(pid=31906): stdout: | (launched: 2022-12-09_05:56:57.242688) 05:57:00.312612 run osmo-hlr_10.42.42.2(pid=31906): stderr: | 20221209055657432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055657432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055657432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055657432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055657432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055657432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055657444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055657452 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055657452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055657452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:00.385367 run osmo-msc_10.42.42.6(pid=31912): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31912)] 05:57:00.435770 run osmo-msc_10.42.42.6(pid=31912): stdout: | (launched: 2022-12-09_05:56:59.253334) 05:57:00.488164 run osmo-msc_10.42.42.6(pid=31912): stderr: | 20221209055659576 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055659576 DLGLOBAL DEBUG validating counter group 0x7fde0a517c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055659576 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055659576 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055659576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055659577 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055659579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055659579 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055659579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055659579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:00.540844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31905): Terminating (SIGTERM) 05:57:00.583114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31908): Terminating (SIGTERM) 05:57:00.625496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31911): Terminating (SIGTERM) 05:57:00.667899 --- ParallelTerminationStrategy: PID 31905 died... 05:57:00.687610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31905): Terminated: ok {rc=0} 05:57:00.734208 --- ParallelTerminationStrategy: PID 31908 died... 05:57:00.753790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31908): Terminated: ok {rc=0} 05:57:00.800068 --- ParallelTerminationStrategy: PID 31911 died... 05:57:00.819758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31911): Terminated: ok {rc=0} 05:57:00.914060 bus /sierra_3: Setting Powered False 05:57:02.033666 bus /sierra_3: Setting Powered False 05:57:03.159209 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 05:57:04.307035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.319460 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 05:57:04.390181 tst mo_mt_call_osmux.py: using LAC 19401 05:57:04.515214 tst mo_mt_call_osmux.py: using RAC 21 05:57:04.639517 tst mo_mt_call_osmux.py: using CellId 19401 05:57:04.762535 tst mo_mt_call_osmux.py: using BVCI 19402 05:57:04.879197 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.891162 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.902904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.914758 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.926721 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 05:57:04.938701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:05.051631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 05:57:05.170630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:05.665245 run create_hlr_db(pid=31914): Launched 05:57:05.794046 bus /sierra_2: Setting Powered False 05:57:06.857912 run create_hlr_db(pid=31914): Terminated: ok {rc=0} 05:57:07.300665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Launched 05:57:07.618258 run osmo-hlr_10.42.42.2(pid=31917): Launched 05:57:07.738927 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:08.292092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Launched 05:57:08.610612 run osmo-stp_10.42.42.5(pid=31920): Launched 05:57:08.732009 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:09.308739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31922): Launched 05:57:09.627252 run osmo-msc_10.42.42.6(pid=31923): Launched 05:57:09.805203 run osmo-stp_10.42.42.5(pid=31920): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] 05:57:09.942102 run osmo-stp_10.42.42.5(pid=31920): stdout: | (launched: 2022-12-09_05:57:08.552809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:10.078688 run osmo-stp_10.42.42.5(pid=31920): stderr: | 20221209055708744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055708744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055708744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055708745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055708745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055708745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055708745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:10.213248 run osmo-stp_10.42.42.5(pid=31920): stdout: | (launched: 2022-12-09_05:57:08.552809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:10.340038 run osmo-stp_10.42.42.5(pid=31920): stderr: | 20221209055708744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055708744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055708744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055708745 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055708745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055708745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055708745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:10.491607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31920): Process ended prematurely: osmo-stp_10.42.42.5(pid=31920) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 05:57:10.501254 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:57:10.528866 run osmo-hlr_10.42.42.2(pid=31917): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31917)] 05:57:10.578856 run osmo-hlr_10.42.42.2(pid=31917): stdout: | (launched: 2022-12-09_05:57:07.560901) 05:57:10.630707 run osmo-hlr_10.42.42.2(pid=31917): stderr: | 20221209055707758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055707758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055707758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055707758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055707758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055707758 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055707770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055707779 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055707779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055707779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:10.702558 run osmo-msc_10.42.42.6(pid=31923): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31923)] 05:57:10.752269 run osmo-msc_10.42.42.6(pid=31923): stdout: | (launched: 2022-12-09_05:57:09.569531) 05:57:10.803705 run osmo-msc_10.42.42.6(pid=31923): stderr: | 20221209055709890 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055709890 DLGLOBAL DEBUG validating counter group 0x7f6289cdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055709891 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055709891 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055709891 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055709891 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055709893 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055709893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055709893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055709893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:10.855755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Terminating (SIGTERM) 05:57:10.897306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Terminating (SIGTERM) 05:57:10.938998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31922): Terminating (SIGTERM) 05:57:10.980907 --- ParallelTerminationStrategy: PID 31916 died... 05:57:11.000334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31916): Terminated: ok {rc=0} 05:57:11.046240 --- ParallelTerminationStrategy: PID 31919 died... 05:57:11.065732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31919): Terminated: ok {rc=0} 05:57:11.111382 --- ParallelTerminationStrategy: PID 31922 died... 05:57:11.130780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31922): Terminated: ok {rc=0} 05:57:11.218681 bus /sierra_3: Setting Powered False 05:57:12.318424 bus /sierra_3: Setting Powered False 05:57:13.433237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 05:57:14.687049 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:14.694515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 05:57:14.729247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 05:57:14.756326 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 05:57:14.810459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 05:57:14.845017 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 05:57:14.872365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 05:57:15.418689 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 05:57:15.467557 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:15.478977 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:57:15.551750 tst mo_mt_call.py: using LAC 19402 05:57:15.669025 tst mo_mt_call.py: using RAC 22 05:57:15.784158 tst mo_mt_call.py: using CellId 19402 05:57:15.913842 tst mo_mt_call.py: using BVCI 19403 05:57:16.041287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:16.053530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:16.065554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:16.078762 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:16.091840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:16.105086 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:16.224746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:16.339334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:16.818912 run create_hlr_db(pid=31928): Launched 05:57:16.972130 bus /sierra_2: Setting Powered False 05:57:18.031654 run create_hlr_db(pid=31928): Terminated: ok {rc=0} 05:57:18.466330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Launched 05:57:18.784639 run osmo-hlr_10.42.42.2(pid=31931): Launched 05:57:18.907004 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:19.454333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Launched 05:57:19.771986 run osmo-stp_10.42.42.5(pid=31934): Launched 05:57:19.892748 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:20.466524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31936): Launched 05:57:20.784285 run osmo-msc_10.42.42.6(pid=31937): Launched 05:57:20.962916 run osmo-stp_10.42.42.5(pid=31934): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] 05:57:21.098701 run osmo-stp_10.42.42.5(pid=31934): stdout: | (launched: 2022-12-09_05:57:19.714459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:21.234179 run osmo-stp_10.42.42.5(pid=31934): stderr: | 20221209055719907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055719907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055719908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055719908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055719908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055719909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055719909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:21.369083 run osmo-stp_10.42.42.5(pid=31934): stdout: | (launched: 2022-12-09_05:57:19.714459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:21.495705 run osmo-stp_10.42.42.5(pid=31934): stderr: | 20221209055719907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055719907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055719908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055719908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055719908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055719909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055719909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:21.647153 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31934): Process ended prematurely: osmo-stp_10.42.42.5(pid=31934) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 05:57:21.656427 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:21.683869 run osmo-hlr_10.42.42.2(pid=31931): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31931)] 05:57:21.733408 run osmo-hlr_10.42.42.2(pid=31931): stdout: | (launched: 2022-12-09_05:57:18.727071) 05:57:21.784830 run osmo-hlr_10.42.42.2(pid=31931): stderr: | 20221209055718925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055718925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055718925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055718925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055718925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055718925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055718937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055718945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055718946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055718946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:21.856730 run osmo-msc_10.42.42.6(pid=31937): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31937)] 05:57:21.906666 run osmo-msc_10.42.42.6(pid=31937): stdout: | (launched: 2022-12-09_05:57:20.726710) 05:57:21.957968 run osmo-msc_10.42.42.6(pid=31937): stderr: | 20221209055721051 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055721051 DLGLOBAL DEBUG validating counter group 0x7ff4719a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055721051 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055721052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055721052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055721052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055721054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055721054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055721054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055721054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:22.009512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminating (SIGTERM) 05:57:22.050753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Terminating (SIGTERM) 05:57:22.092255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31936): Terminating (SIGTERM) 05:57:22.133990 --- ParallelTerminationStrategy: PID 31930 died... 05:57:22.153325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminated: ok {rc=0} 05:57:22.199126 --- ParallelTerminationStrategy: PID 31933 died... 05:57:22.218370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31933): Terminated: ok {rc=0} 05:57:22.263906 --- ParallelTerminationStrategy: PID 31936 died... 05:57:22.283244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31936): Terminated: ok {rc=0} 05:57:22.370312 bus /sierra_3: Setting Powered False 05:57:23.470222 bus /sierra_3: Setting Powered False 05:57:24.589605 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 05:57:25.735065 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:25.746891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 05:57:25.816845 tst mo_mt_call_osmux.py: using LAC 19403 05:57:25.933437 tst mo_mt_call_osmux.py: using RAC 23 05:57:26.060562 tst mo_mt_call_osmux.py: using CellId 19403 05:57:26.185794 tst mo_mt_call_osmux.py: using BVCI 19404 05:57:26.303653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:26.315507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:26.327094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:26.338513 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:26.350056 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 05:57:26.361426 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:26.474633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 05:57:26.593577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:27.054278 run create_hlr_db(pid=31939): Launched 05:57:27.168589 bus /sierra_2: Setting Powered False 05:57:28.227881 run create_hlr_db(pid=31939): Terminated: ok {rc=0} 05:57:28.662418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Launched 05:57:28.980923 run osmo-hlr_10.42.42.2(pid=31942): Launched 05:57:29.102828 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:29.651723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Launched 05:57:29.971225 run osmo-stp_10.42.42.5(pid=31945): Launched 05:57:30.092382 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:30.669482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31947): Launched 05:57:31.002518 run osmo-msc_10.42.42.6(pid=31948): Launched 05:57:31.351427 run osmo-stp_10.42.42.5(pid=31945): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] 05:57:31.724933 run osmo-stp_10.42.42.5(pid=31945): stdout: | (launched: 2022-12-09_05:57:29.913477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:31.856544 run osmo-stp_10.42.42.5(pid=31945): stderr: | 20221209055730106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055730106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055730106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055730107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055730107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055730107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055730107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:31.991264 run osmo-stp_10.42.42.5(pid=31945): stdout: | (launched: 2022-12-09_05:57:29.913477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:32.118097 run osmo-stp_10.42.42.5(pid=31945): stderr: | 20221209055730106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055730106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055730106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055730107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055730107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055730107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055730107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:32.268199 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31945): Process ended prematurely: osmo-stp_10.42.42.5(pid=31945) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 05:57:32.278179 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 05:57:32.307521 run osmo-hlr_10.42.42.2(pid=31942): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31942)] 05:57:32.357661 run osmo-hlr_10.42.42.2(pid=31942): stdout: | (launched: 2022-12-09_05:57:28.923384) 05:57:32.408360 run osmo-hlr_10.42.42.2(pid=31942): stderr: | 20221209055729118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055729119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055729119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055729119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055729119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055729119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055729131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055729139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055729139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055729139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:32.478721 run osmo-msc_10.42.42.6(pid=31948): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31948)] 05:57:32.527453 run osmo-msc_10.42.42.6(pid=31948): stdout: | (launched: 2022-12-09_05:57:30.937902) 05:57:32.577759 run osmo-msc_10.42.42.6(pid=31948): stderr: | 20221209055731441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055731441 DLGLOBAL DEBUG validating counter group 0x7f3a7c68cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055731441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055731441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055731442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055731442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055731448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055731448 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055731448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055731448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:32.628556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Terminating (SIGTERM) 05:57:32.669466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Terminating (SIGTERM) 05:57:32.710158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31947): Terminating (SIGTERM) 05:57:32.751616 --- ParallelTerminationStrategy: PID 31941 died... 05:57:32.770893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Terminated: ok {rc=0} 05:57:32.816851 --- ParallelTerminationStrategy: PID 31944 died... 05:57:32.835624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Terminated: ok {rc=0} 05:57:32.881256 --- ParallelTerminationStrategy: PID 31947 died... 05:57:32.899742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31947): Terminated: ok {rc=0} 05:57:32.987100 bus /sierra_3: Setting Powered False 05:57:34.085673 bus /sierra_3: Setting Powered False 05:57:35.201732 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 05:57:36.454396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:36.460566 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 05:57:36.494205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 05:57:36.520647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 05:57:36.569751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 05:57:36.602817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 05:57:36.628909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 05:57:37.186552 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 05:57:37.234317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.245451 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:57:37.313757 tst mo_mt_call.py: using LAC 19404 05:57:37.441886 tst mo_mt_call.py: using RAC 24 05:57:37.567093 tst mo_mt_call.py: using CellId 19404 05:57:37.690183 tst mo_mt_call.py: using BVCI 19405 05:57:37.805641 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.817373 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.828839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.840233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.851715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:37.863437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:37.976818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:38.090931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:38.550477 run create_hlr_db(pid=31955): Launched 05:57:38.665206 bus /sierra_2: Setting Powered False 05:57:39.724698 run create_hlr_db(pid=31955): Terminated: ok {rc=0} 05:57:40.159054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Launched 05:57:40.478101 run osmo-hlr_10.42.42.2(pid=31958): Launched 05:57:40.598962 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:41.146271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Launched 05:57:41.464782 run osmo-stp_10.42.42.5(pid=31961): Launched 05:57:41.586814 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:42.164519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31963): Launched 05:57:42.484087 run osmo-msc_10.42.42.6(pid=31964): Launched 05:57:42.662023 run osmo-stp_10.42.42.5(pid=31961): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31961)] 05:57:42.797720 run osmo-stp_10.42.42.5(pid=31961): stdout: | (launched: 2022-12-09_05:57:41.407045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:42.933829 run osmo-stp_10.42.42.5(pid=31961): stderr: | 20221209055741599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055741599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055741599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055741600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055741602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055741602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055741602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:43.068686 run osmo-stp_10.42.42.5(pid=31961): stdout: | (launched: 2022-12-09_05:57:41.407045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:43.195738 run osmo-stp_10.42.42.5(pid=31961): stderr: | 20221209055741599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055741599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055741599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055741600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055741602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055741602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055741602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:43.347837 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31961): Process ended prematurely: osmo-stp_10.42.42.5(pid=31961) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31961)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 05:57:43.357391 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 05:57:43.384901 run osmo-hlr_10.42.42.2(pid=31958): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31958)] 05:57:43.435368 run osmo-hlr_10.42.42.2(pid=31958): stdout: | (launched: 2022-12-09_05:57:40.420340) 05:57:43.487148 run osmo-hlr_10.42.42.2(pid=31958): stderr: | 20221209055740617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055740617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055740617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055740617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055740617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055740617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055740629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055740638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055740638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055740638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:43.559328 run osmo-msc_10.42.42.6(pid=31964): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31964)] 05:57:43.609168 run osmo-msc_10.42.42.6(pid=31964): stdout: | (launched: 2022-12-09_05:57:42.426079) 05:57:43.660363 run osmo-msc_10.42.42.6(pid=31964): stderr: | 20221209055742750 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055742750 DLGLOBAL DEBUG validating counter group 0x7fb124142c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055742750 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055742750 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055742750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055742750 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055742752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055742752 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055742753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055742753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:43.712052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Terminating (SIGTERM) 05:57:43.753690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Terminating (SIGTERM) 05:57:43.795535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31963): Terminating (SIGTERM) 05:57:43.837720 --- ParallelTerminationStrategy: PID 31957 died... 05:57:43.857590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31957): Terminated: ok {rc=0} 05:57:43.903976 --- ParallelTerminationStrategy: PID 31960 died... 05:57:43.923671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31960): Terminated: ok {rc=0} 05:57:43.969561 --- ParallelTerminationStrategy: PID 31963 died... 05:57:43.989024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31963): Terminated: ok {rc=0} 05:57:44.076102 bus /sierra_3: Setting Powered False 05:57:45.174323 bus /sierra_3: Setting Powered False 05:57:46.289722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 05:57:47.438394 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:47.450921 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 05:57:47.522457 tst mo_mt_call_osmux.py: using LAC 19405 05:57:47.649729 tst mo_mt_call_osmux.py: using RAC 25 05:57:47.775698 tst mo_mt_call_osmux.py: using CellId 19405 05:57:47.903014 tst mo_mt_call_osmux.py: using BVCI 19406 05:57:48.020604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:48.032280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:48.043647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:48.055039 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:48.066474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 05:57:48.077853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:48.192462 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 05:57:48.307759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:48.771197 run create_hlr_db(pid=31966): Launched 05:57:48.885901 bus /sierra_2: Setting Powered False 05:57:49.945739 run create_hlr_db(pid=31966): Terminated: ok {rc=0} 05:57:50.382252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Launched 05:57:50.701576 run osmo-hlr_10.42.42.2(pid=31969): Launched 05:57:50.823614 run osmo-stp_10.42.42.5: Starting osmo-stp 05:57:51.378571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Launched 05:57:51.698408 run osmo-stp_10.42.42.5(pid=31972): Launched 05:57:51.820173 run osmo-msc_10.42.42.6: Starting osmo-msc 05:57:52.433858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31974): Launched 05:57:52.751004 run osmo-msc_10.42.42.6(pid=31975): Launched 05:57:52.929206 run osmo-stp_10.42.42.5(pid=31972): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] 05:57:53.063436 run osmo-stp_10.42.42.5(pid=31972): stdout: | (launched: 2022-12-09_05:57:51.640673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:53.198378 run osmo-stp_10.42.42.5(pid=31972): stderr: | 20221209055751831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055751832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055751832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055751832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055751835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055751835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055751835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:53.332402 run osmo-stp_10.42.42.5(pid=31972): stdout: | (launched: 2022-12-09_05:57:51.640673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:57:53.459321 run osmo-stp_10.42.42.5(pid=31972): stderr: | 20221209055751831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055751832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055751832 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055751832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055751835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055751835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055751835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:57:53.611667 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31972): Process ended prematurely: osmo-stp_10.42.42.5(pid=31972) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 05:57:53.621164 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 05:57:53.648581 run osmo-hlr_10.42.42.2(pid=31969): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31969)] 05:57:53.698605 run osmo-hlr_10.42.42.2(pid=31969): stdout: | (launched: 2022-12-09_05:57:50.643813) 05:57:53.750285 run osmo-hlr_10.42.42.2(pid=31969): stderr: | 20221209055750840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055750840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055750840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055750840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055750840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055750840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055750851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055750859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055750859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055750859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:57:53.822155 run osmo-msc_10.42.42.6(pid=31975): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31975)] 05:57:53.872263 run osmo-msc_10.42.42.6(pid=31975): stdout: | (launched: 2022-12-09_05:57:52.693438) 05:57:53.923892 run osmo-msc_10.42.42.6(pid=31975): stderr: | 20221209055753017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055753017 DLGLOBAL DEBUG validating counter group 0x7f08803bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055753017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055753018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055753018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055753018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055753020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055753020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055753020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055753020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:57:53.975752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminating (SIGTERM) 05:57:54.017418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminating (SIGTERM) 05:57:54.059171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31974): Terminating (SIGTERM) 05:57:54.101119 --- ParallelTerminationStrategy: PID 31968 died... 05:57:54.120862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminated: ok {rc=0} 05:57:54.166724 --- ParallelTerminationStrategy: PID 31971 died... 05:57:54.186132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminated: ok {rc=0} 05:57:54.231684 --- ParallelTerminationStrategy: PID 31974 died... 05:57:54.251160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31974): Terminated: ok {rc=0} 05:57:54.338468 bus /sierra_3: Setting Powered False 05:57:55.437770 bus /sierra_3: Setting Powered False 05:57:56.555683 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 05:57:57.810872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:57:57.817863 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 05:57:57.852361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 05:57:57.879981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 05:57:57.932519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 05:57:57.966719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 05:57:57.993764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 05:57:58.547072 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 05:57:58.598554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:58.610304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:57:58.685602 tst mo_mt_call.py: using LAC 19406 05:57:58.811873 tst mo_mt_call.py: using RAC 26 05:57:58.936582 tst mo_mt_call.py: using CellId 19406 05:57:59.061965 tst mo_mt_call.py: using BVCI 19407 05:57:59.171145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:59.182310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:59.193467 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:59.204726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:59.215945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:57:59.227275 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:59.345685 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:57:59.465433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:57:59.961355 run create_hlr_db(pid=31980): Launched 05:58:00.091449 bus /sierra_2: Setting Powered False 05:58:01.151219 run create_hlr_db(pid=31980): Terminated: ok {rc=0} 05:58:01.589667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31982): Launched 05:58:01.920460 run osmo-hlr_10.42.42.2(pid=31983): Launched 05:58:02.155245 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:02.711313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Launched 05:58:03.031258 run osmo-stp_10.42.42.5(pid=31986): Launched 05:58:03.151809 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:03.727187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31988): Launched 05:58:04.045714 run osmo-msc_10.42.42.6(pid=31989): Launched 05:58:04.222767 run osmo-stp_10.42.42.5(pid=31986): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31986)] 05:58:04.358274 run osmo-stp_10.42.42.5(pid=31986): stdout: | (launched: 2022-12-09_05:58:02.972428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:04.492868 run osmo-stp_10.42.42.5(pid=31986): stderr: | 20221209055803163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055803163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055803164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055803164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055803165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055803165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055803165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:04.627671 run osmo-stp_10.42.42.5(pid=31986): stdout: | (launched: 2022-12-09_05:58:02.972428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:04.754769 run osmo-stp_10.42.42.5(pid=31986): stderr: | 20221209055803163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055803163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055803164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055803164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055803165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055803165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055803165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:04.907109 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31986): Process ended prematurely: osmo-stp_10.42.42.5(pid=31986) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31986)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 05:58:04.916443 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:58:04.944153 run osmo-hlr_10.42.42.2(pid=31983): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31983)] 05:58:04.993777 run osmo-hlr_10.42.42.2(pid=31983): stdout: | (launched: 2022-12-09_05:58:01.847136) 05:58:05.045281 run osmo-hlr_10.42.42.2(pid=31983): stderr: | 20221209055802179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055802179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055802179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055802179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055802179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055802179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055802191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055802200 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055802200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055802200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:05.116697 run osmo-msc_10.42.42.6(pid=31989): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31989)] 05:58:05.166329 run osmo-msc_10.42.42.6(pid=31989): stdout: | (launched: 2022-12-09_05:58:03.988260) 05:58:05.217731 run osmo-msc_10.42.42.6(pid=31989): stderr: | 20221209055804308 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055804308 DLGLOBAL DEBUG validating counter group 0x7f3dfb403c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055804308 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055804308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055804309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055804309 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055804310 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055804311 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055804311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055804311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:05.269353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31982): Terminating (SIGTERM) 05:58:05.310992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Terminating (SIGTERM) 05:58:05.352811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31988): Terminating (SIGTERM) 05:58:05.395276 --- ParallelTerminationStrategy: PID 31982 died... 05:58:05.415238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31982): Terminated: ok {rc=0} 05:58:05.461408 --- ParallelTerminationStrategy: PID 31985 died... 05:58:05.480715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Terminated: ok {rc=0} 05:58:05.526437 --- ParallelTerminationStrategy: PID 31988 died... 05:58:05.546036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31988): Terminated: ok {rc=0} 05:58:05.634005 bus /sierra_3: Setting Powered False 05:58:06.732088 bus /sierra_3: Setting Powered False 05:58:07.848171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 05:58:08.994894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.006866 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 05:58:09.076085 tst mo_mt_call_osmux.py: using LAC 19407 05:58:09.194822 tst mo_mt_call_osmux.py: using RAC 27 05:58:09.311231 tst mo_mt_call_osmux.py: using CellId 19407 05:58:09.429100 tst mo_mt_call_osmux.py: using BVCI 19408 05:58:09.536747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.547969 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.558926 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.570209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.581515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 05:58:09.592470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:09.706830 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 05:58:09.821281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:10.281698 run create_hlr_db(pid=31991): Launched 05:58:10.394748 bus /sierra_2: Setting Powered False 05:58:11.454238 run create_hlr_db(pid=31991): Terminated: ok {rc=0} 05:58:11.870031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31993): Launched 05:58:12.167311 run osmo-hlr_10.42.42.2(pid=31994): Launched 05:58:12.281167 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:12.809432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31996): Launched 05:58:13.106338 run osmo-stp_10.42.42.5(pid=31997): Launched 05:58:13.219927 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:13.758999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31999): Launched 05:58:14.056678 run osmo-msc_10.42.42.6(pid=32000): Launched 05:58:14.223673 run osmo-stp_10.42.42.5(pid=31997): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31997)] 05:58:14.351709 run osmo-stp_10.42.42.5(pid=31997): stdout: | (launched: 2022-12-09_05:58:13.051851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:14.479175 run osmo-stp_10.42.42.5(pid=31997): stderr: | 20221209055813220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055813220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055813221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055813221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055813221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055813222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055813222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:14.603984 run osmo-stp_10.42.42.5(pid=31997): stdout: | (launched: 2022-12-09_05:58:13.051851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:14.722896 run osmo-stp_10.42.42.5(pid=31997): stderr: | 20221209055813220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055813220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055813221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055813221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055813221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055813222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055813222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:14.865567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31997): Process ended prematurely: osmo-stp_10.42.42.5(pid=31997) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31997)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 05:58:14.874551 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 05:58:14.901207 run osmo-hlr_10.42.42.2(pid=31994): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31994)] 05:58:14.949384 run osmo-hlr_10.42.42.2(pid=31994): stdout: | (launched: 2022-12-09_05:58:12.113360) 05:58:14.999179 run osmo-hlr_10.42.42.2(pid=31994): stderr: | 20221209055812286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055812286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055812286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055812286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055812287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055812287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055812298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055812307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055812307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055812307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:15.069157 run osmo-msc_10.42.42.6(pid=32000): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32000)] 05:58:15.117379 run osmo-msc_10.42.42.6(pid=32000): stdout: | (launched: 2022-12-09_05:58:14.002196) 05:58:15.166881 run osmo-msc_10.42.42.6(pid=32000): stderr: | 20221209055814272 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055814272 DLGLOBAL DEBUG validating counter group 0x7fb5a8800c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055814273 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055814273 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055814273 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055814274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055814275 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055814276 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055814276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055814276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:15.217115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31993): Terminating (SIGTERM) 05:58:15.257008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31996): Terminating (SIGTERM) 05:58:15.297037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31999): Terminating (SIGTERM) 05:58:15.337304 --- ParallelTerminationStrategy: PID 31993 died... 05:58:15.356467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31993): Terminated: ok {rc=0} 05:58:15.401157 --- ParallelTerminationStrategy: PID 31996 died... 05:58:15.419808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31996): Terminated: ok {rc=0} 05:58:15.464241 --- ParallelTerminationStrategy: PID 31999 died... 05:58:15.483057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31999): Terminated: ok {rc=0} 05:58:15.570020 bus /sierra_3: Setting Powered False 05:58:16.688175 bus /sierra_3: Setting Powered False 05:58:17.821511 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 05:58:19.080238 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:19.087330 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 05:58:19.121572 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 05:58:19.148609 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 05:58:19.201727 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 05:58:19.237043 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 05:58:19.263835 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 05:58:19.812075 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 05:58:19.860867 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:19.872515 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:58:19.942843 tst mo_mt_call.py: using LAC 19408 05:58:20.060120 tst mo_mt_call.py: using RAC 28 05:58:20.177370 tst mo_mt_call.py: using CellId 19408 05:58:20.297568 tst mo_mt_call.py: using BVCI 19409 05:58:20.406207 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:20.417491 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:20.428404 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:20.439690 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:20.450937 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:20.462214 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:20.579798 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:20.699129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:21.193281 run create_hlr_db(pid=32005): Launched 05:58:21.322970 bus /sierra_2: Setting Powered False 05:58:22.385941 run create_hlr_db(pid=32005): Terminated: ok {rc=0} 05:58:22.810052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Launched 05:58:23.105742 run osmo-hlr_10.42.42.2(pid=32008): Launched 05:58:23.217988 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:23.741432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Launched 05:58:24.037750 run osmo-stp_10.42.42.5(pid=32011): Launched 05:58:24.151030 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:24.688398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32013): Launched 05:58:24.985671 run osmo-msc_10.42.42.6(pid=32014): Launched 05:58:25.150556 run osmo-stp_10.42.42.5(pid=32011): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] 05:58:25.277530 run osmo-stp_10.42.42.5(pid=32011): stdout: | (launched: 2022-12-09_05:58:23.983760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:25.404573 run osmo-stp_10.42.42.5(pid=32011): stderr: | 20221209055824152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055824152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055824152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055824152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055824153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055824153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055824153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:25.529543 run osmo-stp_10.42.42.5(pid=32011): stdout: | (launched: 2022-12-09_05:58:23.983760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:25.647979 run osmo-stp_10.42.42.5(pid=32011): stderr: | 20221209055824152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055824152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055824152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055824152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055824153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055824153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055824153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:25.790209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32011): Process ended prematurely: osmo-stp_10.42.42.5(pid=32011) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 05:58:25.799130 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 05:58:25.826294 run osmo-hlr_10.42.42.2(pid=32008): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32008)] 05:58:25.874427 run osmo-hlr_10.42.42.2(pid=32008): stdout: | (launched: 2022-12-09_05:58:23.051631) 05:58:25.924519 run osmo-hlr_10.42.42.2(pid=32008): stderr: | 20221209055823225 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055823225 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055823225 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055823225 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055823225 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055823225 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055823238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055823247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055823248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055823248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:25.993764 run osmo-msc_10.42.42.6(pid=32014): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32014)] 05:58:26.041454 run osmo-msc_10.42.42.6(pid=32014): stdout: | (launched: 2022-12-09_05:58:24.931355) 05:58:26.091262 run osmo-msc_10.42.42.6(pid=32014): stderr: | 20221209055825202 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055825202 DLGLOBAL DEBUG validating counter group 0x7fefb6868c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055825202 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055825202 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055825202 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055825203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055825207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055825207 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055825207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055825207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:26.141253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Terminating (SIGTERM) 05:58:26.181188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Terminating (SIGTERM) 05:58:26.221310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32013): Terminating (SIGTERM) 05:58:26.261815 --- ParallelTerminationStrategy: PID 32007 died... 05:58:26.280803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32007): Terminated: ok {rc=0} 05:58:26.325288 --- ParallelTerminationStrategy: PID 32010 died... 05:58:26.343840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32010): Terminated: ok {rc=0} 05:58:26.388455 --- ParallelTerminationStrategy: PID 32013 died... 05:58:26.407037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32013): Terminated: ok {rc=0} 05:58:26.492383 bus /sierra_3: Setting Powered False 05:58:27.591758 bus /sierra_3: Setting Powered False 05:58:28.708368 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 05:58:29.852498 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:29.864221 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 05:58:29.934566 tst mo_mt_call_osmux.py: using LAC 19409 05:58:30.053234 tst mo_mt_call_osmux.py: using RAC 29 05:58:30.169591 tst mo_mt_call_osmux.py: using CellId 19409 05:58:30.285967 tst mo_mt_call_osmux.py: using BVCI 19410 05:58:30.393412 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:30.404578 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:30.415613 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:30.426901 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:30.438306 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 05:58:30.449564 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:30.568328 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 05:58:30.686945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:31.203616 run create_hlr_db(pid=32016): Launched 05:58:31.358336 bus /sierra_2: Setting Powered False 05:58:32.421460 run create_hlr_db(pid=32016): Terminated: ok {rc=0} 05:58:32.847988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Launched 05:58:33.145173 run osmo-hlr_10.42.42.2(pid=32019): Launched 05:58:33.258092 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:33.786369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Launched 05:58:34.082470 run osmo-stp_10.42.42.5(pid=32022): Launched 05:58:34.194418 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:34.731623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Launched 05:58:35.028301 run osmo-msc_10.42.42.6(pid=32025): Launched 05:58:35.195096 run osmo-stp_10.42.42.5(pid=32022): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] 05:58:35.322836 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_05:58:34.028330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:35.449522 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209055834197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055834198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055834198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055834198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055834199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055834199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055834199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:35.574173 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_05:58:34.028330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:35.692326 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209055834197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055834198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055834198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055834198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055834199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055834199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055834199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:35.834884 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 05:58:35.843781 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:58:35.870139 run osmo-hlr_10.42.42.2(pid=32019): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32019)] 05:58:35.917906 run osmo-hlr_10.42.42.2(pid=32019): stdout: | (launched: 2022-12-09_05:58:33.090707) 05:58:35.967298 run osmo-hlr_10.42.42.2(pid=32019): stderr: | 20221209055833267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055833267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055833267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055833267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055833267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055833267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055833283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055833293 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055833293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055833293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:36.035767 run osmo-msc_10.42.42.6(pid=32025): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32025)] 05:58:36.083335 run osmo-msc_10.42.42.6(pid=32025): stdout: | (launched: 2022-12-09_05:58:34.973950) 05:58:36.132895 run osmo-msc_10.42.42.6(pid=32025): stderr: | 20221209055835247 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055835247 DLGLOBAL DEBUG validating counter group 0x7f2c4bc8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055835247 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055835247 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055835247 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055835247 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055835249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055835250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055835250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055835250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:36.182354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminating (SIGTERM) 05:58:36.221756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminating (SIGTERM) 05:58:36.261487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Terminating (SIGTERM) 05:58:36.301375 --- ParallelTerminationStrategy: PID 32018 died... 05:58:36.320210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminated: ok {rc=0} 05:58:36.364756 --- ParallelTerminationStrategy: PID 32021 died... 05:58:36.383130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminated: ok {rc=0} 05:58:36.426990 --- ParallelTerminationStrategy: PID 32024 died... 05:58:36.445396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Terminated: ok {rc=0} 05:58:36.530968 bus /sierra_3: Setting Powered False 05:58:37.628804 bus /sierra_3: Setting Powered False 05:58:38.743726 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 05:58:39.992344 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:58:39.997870 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 05:58:40.031496 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 05:58:40.057515 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 05:58:40.109588 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 05:58:40.143370 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 05:58:40.169503 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 05:58:40.717367 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 05:58:40.765041 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:40.775921 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:58:40.848238 tst mo_mt_call.py: using LAC 19410 05:58:40.965621 tst mo_mt_call.py: using RAC 30 05:58:41.090549 tst mo_mt_call.py: using CellId 19410 05:58:41.214634 tst mo_mt_call.py: using BVCI 19411 05:58:41.330907 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:41.342514 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:41.353875 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:41.365552 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:41.376882 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:41.388696 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:41.503493 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:41.618641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:42.083606 run create_hlr_db(pid=32031): Launched 05:58:42.197954 bus /sierra_2: Setting Powered False 05:58:43.257496 run create_hlr_db(pid=32031): Terminated: ok {rc=0} 05:58:43.673729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Launched 05:58:43.972703 run osmo-hlr_10.42.42.2(pid=32034): Launched 05:58:44.086841 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:44.610999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Launched 05:58:44.909065 run osmo-stp_10.42.42.5(pid=32037): Launched 05:58:45.022737 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:45.562084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32039): Launched 05:58:45.865650 run osmo-msc_10.42.42.6(pid=32040): Launched 05:58:46.138969 run osmo-stp_10.42.42.5(pid=32037): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32037)] 05:58:46.453842 run osmo-stp_10.42.42.5(pid=32037): stdout: | (launched: 2022-12-09_05:58:44.854687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:46.725362 run osmo-stp_10.42.42.5(pid=32037): stderr: | 20221209055845023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055845023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055845024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055845024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055845025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055845025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055845025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:46.881869 run osmo-stp_10.42.42.5(pid=32037): stdout: | (launched: 2022-12-09_05:58:44.854687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:47.013062 run osmo-stp_10.42.42.5(pid=32037): stderr: | 20221209055845023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055845023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055845024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055845024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055845025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055845025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055845025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:47.169978 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32037): Process ended prematurely: osmo-stp_10.42.42.5(pid=32037) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32037)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 05:58:47.180362 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 05:58:47.209559 run osmo-hlr_10.42.42.2(pid=32034): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32034)] 05:58:47.262605 run osmo-hlr_10.42.42.2(pid=32034): stdout: | (launched: 2022-12-09_05:58:43.918140) 05:58:47.316225 run osmo-hlr_10.42.42.2(pid=32034): stderr: | 20221209055844095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055844095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055844095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055844095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055844095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055844095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055844107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055844116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055844116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055844116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:47.390658 run osmo-msc_10.42.42.6(pid=32040): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32040)] 05:58:47.442362 run osmo-msc_10.42.42.6(pid=32040): stdout: | (launched: 2022-12-09_05:58:45.804876) 05:58:47.494763 run osmo-msc_10.42.42.6(pid=32040): stderr: | 20221209055846354 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055846355 DLGLOBAL DEBUG validating counter group 0x7f7dd2b5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055846355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055846355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055846355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055846355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055846358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055846359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055846359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055846359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:47.547349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Terminating (SIGTERM) 05:58:47.589521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Terminating (SIGTERM) 05:58:47.631934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32039): Terminating (SIGTERM) 05:58:47.674907 --- ParallelTerminationStrategy: PID 32033 died... 05:58:47.695107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32033): Terminated: ok {rc=0} 05:58:47.741991 --- ParallelTerminationStrategy: PID 32036 died... 05:58:47.761771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32036): Terminated: ok {rc=0} 05:58:47.808087 --- ParallelTerminationStrategy: PID 32039 died... 05:58:47.827988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32039): Terminated: ok {rc=0} 05:58:47.917217 bus /sierra_3: Setting Powered False 05:58:49.015686 bus /sierra_3: Setting Powered False 05:58:50.132275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 05:58:51.282880 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.295139 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 05:58:51.368614 tst mo_mt_call_osmux.py: using LAC 19411 05:58:51.497828 tst mo_mt_call_osmux.py: using RAC 31 05:58:51.622797 tst mo_mt_call_osmux.py: using CellId 19411 05:58:51.746657 tst mo_mt_call_osmux.py: using BVCI 19412 05:58:51.864141 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.875649 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.887194 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.898811 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.910247 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 05:58:51.921515 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:52.034978 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 05:58:52.157960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:58:52.651615 run create_hlr_db(pid=32042): Launched 05:58:52.779816 bus /sierra_2: Setting Powered False 05:58:53.842481 run create_hlr_db(pid=32042): Terminated: ok {rc=0} 05:58:54.269215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Launched 05:58:54.565377 run osmo-hlr_10.42.42.2(pid=32045): Launched 05:58:54.679861 run osmo-stp_10.42.42.5: Starting osmo-stp 05:58:55.196038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Launched 05:58:55.493202 run osmo-stp_10.42.42.5(pid=32048): Launched 05:58:55.606645 run osmo-msc_10.42.42.6: Starting osmo-msc 05:58:56.145801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32050): Launched 05:58:56.443344 run osmo-msc_10.42.42.6(pid=32051): Launched 05:58:56.611790 run osmo-stp_10.42.42.5(pid=32048): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] 05:58:56.739565 run osmo-stp_10.42.42.5(pid=32048): stdout: | (launched: 2022-12-09_05:58:55.438931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:56.866826 run osmo-stp_10.42.42.5(pid=32048): stderr: | 20221209055855608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055855608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055855608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055855609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055855611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055855611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055855611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:56.991640 run osmo-stp_10.42.42.5(pid=32048): stdout: | (launched: 2022-12-09_05:58:55.438931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:58:57.110753 run osmo-stp_10.42.42.5(pid=32048): stderr: | 20221209055855608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055855608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055855608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055855609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055855611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055855611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055855611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:58:57.252556 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32048): Process ended prematurely: osmo-stp_10.42.42.5(pid=32048) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 05:58:57.261677 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 05:58:57.288512 run osmo-hlr_10.42.42.2(pid=32045): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32045)] 05:58:57.336720 run osmo-hlr_10.42.42.2(pid=32045): stdout: | (launched: 2022-12-09_05:58:54.511557) 05:58:57.386830 run osmo-hlr_10.42.42.2(pid=32045): stderr: | 20221209055854687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055854687 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055854687 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055854687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055854687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055854687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055854699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055854708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055854708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055854709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:58:57.456490 run osmo-msc_10.42.42.6(pid=32051): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32051)] 05:58:57.504698 run osmo-msc_10.42.42.6(pid=32051): stdout: | (launched: 2022-12-09_05:58:56.388449) 05:58:57.554739 run osmo-msc_10.42.42.6(pid=32051): stderr: | 20221209055856661 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055856661 DLGLOBAL DEBUG validating counter group 0x7fabb0336c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055856661 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055856661 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055856661 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055856661 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055856664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055856664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055856664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055856664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:58:57.604761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Terminating (SIGTERM) 05:58:57.645282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Terminating (SIGTERM) 05:58:57.685578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32050): Terminating (SIGTERM) 05:58:57.726025 --- ParallelTerminationStrategy: PID 32044 died... 05:58:57.745075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32044): Terminated: ok {rc=0} 05:58:57.789743 --- ParallelTerminationStrategy: PID 32047 died... 05:58:57.808414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32047): Terminated: ok {rc=0} 05:58:57.852758 --- ParallelTerminationStrategy: PID 32050 died... 05:58:57.871380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32050): Terminated: ok {rc=0} 05:58:57.957593 bus /sierra_3: Setting Powered False 05:58:59.056422 bus /sierra_3: Setting Powered False 05:59:00.171923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 05:59:01.429659 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:59:01.434524 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:59:01.470866 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 05:59:01.499053 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 05:59:01.586756 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:59:01.630525 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 05:59:01.666183 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 05:59:02.239318 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 05:59:02.244935 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.255800 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:02.306638 tst emergency_mo_mt_call.py: using LAC 19412 05:59:02.422102 tst emergency_mo_mt_call.py: using RAC 32 05:59:02.534720 tst emergency_mo_mt_call.py: using CellId 19412 05:59:02.647427 tst emergency_mo_mt_call.py: using BVCI 19413 05:59:02.753257 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.764220 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.774947 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.786054 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.797192 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:02.808068 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:02.921181 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:03.040093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:03.526507 run create_hlr_db(pid=32056): Launched 05:59:03.654906 bus /sierra_2: Setting Powered False 05:59:04.716813 run create_hlr_db(pid=32056): Terminated: ok {rc=0} 05:59:05.137268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32058): Launched 05:59:05.428873 run osmo-hlr_10.42.42.2(pid=32059): Launched 05:59:05.540445 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:06.059162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32061): Launched 05:59:06.349867 run osmo-stp_10.42.42.5(pid=32062): Launched 05:59:06.473525 tst emergency_mo_mt_call.py: using MSISDN 7053 05:59:06.624090 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:07.149324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32064): Launched 05:59:07.440641 run osmo-msc_10.42.42.6(pid=32065): Launched 05:59:07.619727 run osmo-stp_10.42.42.5(pid=32062): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32062)] 05:59:07.753884 run osmo-stp_10.42.42.5(pid=32062): stdout: | (launched: 2022-12-09_05:59:06.296648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:07.888236 run osmo-stp_10.42.42.5(pid=32062): stderr: | 20221209055906464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055906465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055906465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055906465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055906468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055906468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055906468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:08.021754 run osmo-stp_10.42.42.5(pid=32062): stdout: | (launched: 2022-12-09_05:59:06.296648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:08.147676 run osmo-stp_10.42.42.5(pid=32062): stderr: | 20221209055906464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055906465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055906465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055906465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055906468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055906468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055906468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:08.297601 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32062): Process ended prematurely: osmo-stp_10.42.42.5(pid=32062) [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32062)] [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 05:59:08.306405 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 05:59:08.333754 run osmo-hlr_10.42.42.2(pid=32059): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32059)] 05:59:08.384265 run osmo-hlr_10.42.42.2(pid=32059): stdout: | (launched: 2022-12-09_05:59:05.375949) 05:59:08.436145 run osmo-hlr_10.42.42.2(pid=32059): stderr: | 20221209055905551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055905551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055905551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055905551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055905551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055905551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055905563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055905571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055905572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055905572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:08.508574 run osmo-msc_10.42.42.6(pid=32065): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32065)] 05:59:08.558781 run osmo-msc_10.42.42.6(pid=32065): stdout: | (launched: 2022-12-09_05:59:07.386948) 05:59:08.610927 run osmo-msc_10.42.42.6(pid=32065): stderr: | 20221209055907699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055907700 DLGLOBAL DEBUG validating counter group 0x7fe6ff368c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055907700 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055907700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055907700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055907700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055907702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055907702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055907703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055907703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:08.663230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32058): Terminating (SIGTERM) 05:59:08.705246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32061): Terminating (SIGTERM) 05:59:08.747380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32064): Terminating (SIGTERM) 05:59:08.789701 --- ParallelTerminationStrategy: PID 32058 died... 05:59:08.809739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32058): Terminated: ok {rc=0} 05:59:08.856032 --- ParallelTerminationStrategy: PID 32061 died... 05:59:08.875609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32061): Terminated: ok {rc=0} 05:59:08.922325 --- ParallelTerminationStrategy: PID 32064 died... 05:59:08.941938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32064): Terminated: ok {rc=0} 05:59:09.030290 bus /sierra_3: Setting Powered False 05:59:10.131297 bus /sierra_3: Setting Powered False 05:59:11.246420 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 05:59:12.332493 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.344280 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:12.396641 tst emergency_preemptive_call.py: using LAC 19413 05:59:12.520211 tst emergency_preemptive_call.py: using RAC 33 05:59:12.635701 tst emergency_preemptive_call.py: using CellId 19413 05:59:12.751958 tst emergency_preemptive_call.py: using BVCI 19414 05:59:12.857969 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.868726 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.879481 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.890558 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.901570 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 05:59:12.912289 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:13.030846 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:13.146977 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:13.263844 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:13.377890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:13.831890 run create_hlr_db(pid=32067): Launched 05:59:13.943519 bus /sierra_2: Setting Powered False 05:59:15.002204 run create_hlr_db(pid=32067): Terminated: ok {rc=0} 05:59:15.411185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32069): Launched 05:59:15.703926 run osmo-hlr_10.42.42.2(pid=32070): Launched 05:59:15.815101 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:16.435460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32072): Launched 05:59:16.751138 run osmo-stp_10.42.42.5(pid=32073): Launched 05:59:17.109974 tst emergency_preemptive_call.py: using MSISDN 7054 05:59:17.308049 run osmo-msc_10.42.42.6: Starting osmo-msc 05:59:17.872016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Launched 05:59:18.185943 run osmo-msc_10.42.42.6(pid=32076): Launched 05:59:18.359895 run osmo-stp_10.42.42.5(pid=32073): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32073)] 05:59:18.492507 run osmo-stp_10.42.42.5(pid=32073): stdout: | (launched: 2022-12-09_05:59:16.686999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:18.625793 run osmo-stp_10.42.42.5(pid=32073): stderr: | 20221209055916914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055916914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055916914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055916915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055916917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055916917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055916917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:18.757961 run osmo-stp_10.42.42.5(pid=32073): stdout: | (launched: 2022-12-09_05:59:16.686999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:18.883277 run osmo-stp_10.42.42.5(pid=32073): stderr: | 20221209055916914 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055916914 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055916914 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055916915 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055916917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055916917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055916917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:19.033760 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32073): Process ended prematurely: osmo-stp_10.42.42.5(pid=32073) [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32073)] [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 05:59:19.042618 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 05:59:19.070214 run osmo-hlr_10.42.42.2(pid=32070): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32070)] 05:59:19.120499 run osmo-hlr_10.42.42.2(pid=32070): stdout: | (launched: 2022-12-09_05:59:15.650137) 05:59:19.172609 run osmo-hlr_10.42.42.2(pid=32070): stderr: | 20221209055915824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055915825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055915825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055915825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055915825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055915825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055915845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055915866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055915866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055915866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:19.245133 run osmo-msc_10.42.42.6(pid=32076): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32076)] 05:59:19.295297 run osmo-msc_10.42.42.6(pid=32076): stdout: | (launched: 2022-12-09_05:59:18.128885) 05:59:19.347166 run osmo-msc_10.42.42.6(pid=32076): stderr: | 20221209055918449 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209055918450 DLGLOBAL DEBUG validating counter group 0x7fcd84a01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209055918450 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209055918450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209055918450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209055918450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209055918452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209055918452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209055918453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209055918453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 05:59:19.399225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32069): Terminating (SIGTERM) 05:59:19.440933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32072): Terminating (SIGTERM) 05:59:19.482740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Terminating (SIGTERM) 05:59:19.524616 --- ParallelTerminationStrategy: PID 32069 died... 05:59:19.544539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32069): Terminated: ok {rc=0} 05:59:19.590616 --- ParallelTerminationStrategy: PID 32072 died... 05:59:19.610125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32072): Terminated: ok {rc=0} 05:59:19.655922 --- ParallelTerminationStrategy: PID 32075 died... 05:59:19.675401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32075): Terminated: ok {rc=0} 05:59:19.763232 bus /sierra_9: Setting Powered False 05:59:20.862835 bus /sierra_9: Setting Powered False 05:59:21.980611 bus /sierra_8: Setting Powered False 05:59:23.079268 bus /sierra_8: Setting Powered False 05:59:24.194916 bus /sierra_3: Setting Powered False 05:59:25.292276 bus /sierra_3: Setting Powered False 05:59:26.410062 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 05:59:27.692296 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 05:59:27.696501 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 05:59:27.730125 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 05:59:27.767806 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 05:59:27.852909 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 05:59:27.887036 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 05:59:27.926650 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 05:59:28.519113 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 05:59:28.571212 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:28.582552 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:28.631357 tst cs_paging_gprs_active.py: using LAC 19414 05:59:28.757415 tst cs_paging_gprs_active.py: using RAC 34 05:59:28.874524 tst cs_paging_gprs_active.py: using CellId 19414 05:59:28.992498 tst cs_paging_gprs_active.py: using BVCI 19415 05:59:29.100580 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.111232 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.121629 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.132367 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.142986 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.153563 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.164247 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.174833 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:29.185893 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:29.304698 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:29.421106 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 05:59:29.621554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:29.921044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32081): Launched 05:59:30.181353 run iperf3-srv_10.42.42.10(pid=32082): Launched 05:59:30.294391 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 05:59:30.493827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:30.793119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32083): Launched 05:59:31.068885 run iperf3-srv_10.42.42.10(pid=32084): Launched 05:59:31.192212 tst cs_paging_gprs_active.py:38: start network... 05:59:31.397121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:31.873617 run create_hlr_db(pid=32085): Launched 05:59:32.022874 bus /sierra_2: Setting Powered False 05:59:33.081885 run create_hlr_db(pid=32085): Terminated: ok {rc=0} 05:59:33.520084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32087): Launched 05:59:33.840251 run osmo-hlr_10.42.42.2(pid=32088): Launched 05:59:33.963246 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:34.514265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32090): Launched 05:59:34.833067 run osmo-stp_10.42.42.5(pid=32091): Launched 05:59:34.955420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:35.508433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32093): Launched 05:59:35.631313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:35.902008 run patchelf(pid=32094): Launched 05:59:36.080787 run osmo-stp_10.42.42.5(pid=32091): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32091)] 05:59:36.216137 run osmo-stp_10.42.42.5(pid=32091): stdout: | (launched: 2022-12-09_05:59:34.775355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:36.354066 run osmo-stp_10.42.42.5(pid=32091): stderr: | 20221209055934966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055934966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055934966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055934967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055934969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055934969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055934969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:36.491153 run osmo-stp_10.42.42.5(pid=32091): stdout: | (launched: 2022-12-09_05:59:34.775355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:36.622829 run osmo-stp_10.42.42.5(pid=32091): stderr: | 20221209055934966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055934966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055934966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055934967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055934969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055934969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055934969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:36.778358 run patchelf(pid=32094): Terminating (SIGINT) 05:59:36.958379 run patchelf(pid=32094): Terminated: ok {rc=0} 05:59:37.088094 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32091): Process ended prematurely: osmo-stp_10.42.42.5(pid=32091) [trial-2355↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32091)] [trial-2355↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 05:59:37.098211 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 05:59:37.126477 run osmo-hlr_10.42.42.2(pid=32088): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32088)] 05:59:37.175970 run osmo-hlr_10.42.42.2(pid=32088): stdout: | (launched: 2022-12-09_05:59:33.782202) 05:59:37.227373 run osmo-hlr_10.42.42.2(pid=32088): stderr: | 20221209055933980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055933980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055933980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055933980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055933980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055933980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055933992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055934000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055934000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055934000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:37.279237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32081): Terminating (SIGTERM) 05:59:37.320908 run iperf3-srv_10.42.42.10(pid=32082): Terminating (SIGTERM) 05:59:37.362694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32083): Terminating (SIGTERM) 05:59:37.404386 run iperf3-srv_10.42.42.10(pid=32084): Terminating (SIGTERM) 05:59:37.445981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32087): Terminating (SIGTERM) 05:59:37.487692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32090): Terminating (SIGTERM) 05:59:37.529687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32093): Terminating (SIGTERM) 05:59:37.571503 --- ParallelTerminationStrategy: PID 32081 died... 05:59:37.591454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32081): Terminated: ok {rc=0} 05:59:37.637648 --- ParallelTerminationStrategy: PID 32082 died... 05:59:37.657070 run iperf3-srv_10.42.42.10(pid=32082): Terminated {rc=256} 05:59:37.702347 --- ParallelTerminationStrategy: PID 32083 died... 05:59:37.721897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32083): Terminated: ok {rc=0} 05:59:37.767638 --- ParallelTerminationStrategy: PID 32084 died... 05:59:37.786889 run iperf3-srv_10.42.42.10(pid=32084): Terminated {rc=256} 05:59:37.833097 --- ParallelTerminationStrategy: PID 32087 died... 05:59:37.852505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32087): Terminated: ok {rc=0} 05:59:37.898553 --- ParallelTerminationStrategy: PID 32090 died... 05:59:37.918069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32090): Terminated: ok {rc=0} 05:59:37.964359 --- ParallelTerminationStrategy: PID 32093 died... 05:59:37.984241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32093): Terminated: ok {rc=0} 05:59:38.073119 bus /gobi_0: Setting Powered False 05:59:39.172238 bus /gobi_0: Setting Powered False 05:59:40.287558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 05:59:41.435802 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:41.447549 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:41.505088 tst iperf3.py: using LAC 19415 05:59:41.630379 tst iperf3.py: using RAC 35 05:59:41.754570 tst iperf3.py: using CellId 19415 05:59:41.895705 tst iperf3.py: using BVCI 19416 05:59:42.007297 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.018318 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.028853 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.040318 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.052535 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.063638 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.075174 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.086502 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:42.098027 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:42.211483 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 05:59:42.412025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:42.711030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32096): Launched 05:59:42.970936 run iperf3-srv_10.42.42.10(pid=32097): Launched 05:59:43.083390 tst iperf3.py:8: start network... 05:59:43.283052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:43.745099 run create_hlr_db(pid=32098): Launched 05:59:43.859100 bus /gobi_6: Setting Powered False 05:59:44.918581 run create_hlr_db(pid=32098): Terminated: ok {rc=0} 05:59:45.355862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32100): Launched 05:59:45.674891 run osmo-hlr_10.42.42.2(pid=32101): Launched 05:59:45.796882 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:46.481451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32103): Launched 05:59:46.826104 run osmo-stp_10.42.42.5(pid=32104): Launched 05:59:47.035287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:47.652828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32106): Launched 05:59:47.767526 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 05:59:48.019668 run patchelf(pid=32107): Launched 05:59:48.185974 run osmo-stp_10.42.42.5(pid=32104): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32104)] 05:59:48.313322 run osmo-stp_10.42.42.5(pid=32104): stdout: | (launched: 2022-12-09_05:59:46.753597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:48.442293 run osmo-stp_10.42.42.5(pid=32104): stderr: | 20221209055947061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055947061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055947062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055947062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055947064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055947064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055947080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:48.570159 run osmo-stp_10.42.42.5(pid=32104): stdout: | (launched: 2022-12-09_05:59:46.753597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 05:59:48.693626 run osmo-stp_10.42.42.5(pid=32104): stderr: | 20221209055947061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055947061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055947062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055947062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055947064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055947064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055947080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 05:59:48.839275 run patchelf(pid=32107): Terminating (SIGINT) 05:59:49.007346 run patchelf(pid=32107): Terminated: ok {rc=0} 05:59:49.128456 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32104): Process ended prematurely: osmo-stp_10.42.42.5(pid=32104) [trial-2355↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32104)] [trial-2355↪gprs:trx-sysmocell5000↪iperf3.py:8] 05:59:49.137855 tst iperf3.py:8: Test FAILED (7.7 sec) 05:59:49.165166 run osmo-hlr_10.42.42.2(pid=32101): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32101)] 05:59:49.213129 run osmo-hlr_10.42.42.2(pid=32101): stdout: | (launched: 2022-12-09_05:59:45.617223) 05:59:49.262911 run osmo-hlr_10.42.42.2(pid=32101): stderr: | 20221209055945812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055945813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055945813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055945813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055945813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055945813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055945825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055945837 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055945837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055945837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 05:59:49.313062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32096): Terminating (SIGTERM) 05:59:49.353334 run iperf3-srv_10.42.42.10(pid=32097): Terminating (SIGTERM) 05:59:49.393166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32100): Terminating (SIGTERM) 05:59:49.433922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32103): Terminating (SIGTERM) 05:59:49.473976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32106): Terminating (SIGTERM) 05:59:49.514151 --- ParallelTerminationStrategy: PID 32096 died... 05:59:49.533221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32096): Terminated: ok {rc=0} 05:59:49.577874 --- ParallelTerminationStrategy: PID 32097 died... 05:59:49.596537 run iperf3-srv_10.42.42.10(pid=32097): Terminated {rc=256} 05:59:49.641416 --- ParallelTerminationStrategy: PID 32100 died... 05:59:49.660053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32100): Terminated: ok {rc=0} 05:59:49.704382 --- ParallelTerminationStrategy: PID 32103 died... 05:59:49.723100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32103): Terminated: ok {rc=0} 05:59:49.767461 --- ParallelTerminationStrategy: PID 32106 died... 05:59:49.786146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32106): Terminated: ok {rc=0} 05:59:49.870513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 05:59:51.012485 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.023813 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 05:59:51.073361 tst iperf3m4.py: using LAC 19416 05:59:51.191635 tst iperf3m4.py: using RAC 36 05:59:51.309384 tst iperf3m4.py: using CellId 19416 05:59:51.428237 tst iperf3m4.py: using BVCI 19417 05:59:51.537878 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.548723 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.559315 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.570297 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.581181 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.591954 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.603006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.613871 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 05:59:51.624784 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:51.741761 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:51.862270 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:51.983076 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 05:59:52.098580 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 05:59:52.298221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:52.597467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Launched 05:59:52.856742 run iperf3-srv_10.42.42.10(pid=32109): Launched 05:59:52.968384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 05:59:53.166551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:53.463289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Launched 05:59:53.720679 run iperf3-srv_10.42.42.10(pid=32111): Launched 05:59:53.832405 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 05:59:54.031526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:54.329769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32112): Launched 05:59:54.589844 run iperf3-srv_10.42.42.10(pid=32113): Launched 05:59:54.701522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 05:59:54.899393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 05:59:55.196381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Launched 05:59:55.456007 run iperf3-srv_10.42.42.10(pid=32115): Launched 05:59:55.567766 tst iperf3m4.py:8: start network... 05:59:55.765664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 05:59:56.225447 run create_hlr_db(pid=32116): Launched 05:59:56.338835 bus /gobi_6: Setting Powered False 05:59:57.398483 run create_hlr_db(pid=32116): Terminated: ok {rc=0} 05:59:57.813754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Launched 05:59:58.111413 run osmo-hlr_10.42.42.2(pid=32119): Launched 05:59:58.224556 run osmo-stp_10.42.42.5: Starting osmo-stp 05:59:58.753658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Launched 05:59:59.051911 run osmo-stp_10.42.42.5(pid=32122): Launched 05:59:59.165362 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 05:59:59.678040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32124): Launched 05:59:59.792270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:00.044081 run patchelf(pid=32125): Launched 06:00:00.209898 run osmo-stp_10.42.42.5(pid=32122): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] 06:00:00.336778 run osmo-stp_10.42.42.5(pid=32122): stdout: | (launched: 2022-12-09_05:59:58.996628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:00.465117 run osmo-stp_10.42.42.5(pid=32122): stderr: | 20221209055959165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055959165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055959165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055959166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055959166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055959166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055959166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:00.593803 run osmo-stp_10.42.42.5(pid=32122): stdout: | (launched: 2022-12-09_05:59:58.996628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:00.717462 run osmo-stp_10.42.42.5(pid=32122): stderr: | 20221209055959165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209055959165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209055959165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209055959166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209055959166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209055959166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209055959166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:00.883862 run patchelf(pid=32125): Terminating (SIGINT) 06:00:01.062335 run patchelf(pid=32125): Terminated: ok {rc=0} 06:00:01.187070 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32122): Process ended prematurely: osmo-stp_10.42.42.5(pid=32122) [trial-2355↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] [trial-2355↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 06:00:01.197809 tst iperf3m4.py:8: Test FAILED (10.2 sec) 06:00:01.232998 run osmo-hlr_10.42.42.2(pid=32119): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32119)] 06:00:01.292566 run osmo-hlr_10.42.42.2(pid=32119): stdout: | (launched: 2022-12-09_05:59:58.057233) 06:00:01.353606 run osmo-hlr_10.42.42.2(pid=32119): stderr: | 20221209055958231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209055958231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209055958231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209055958231 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209055958231 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209055958231 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209055958243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209055958253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209055958253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209055958253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:01.408029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminating (SIGTERM) 06:00:01.450885 run iperf3-srv_10.42.42.10(pid=32109): Terminating (SIGTERM) 06:00:01.493540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminating (SIGTERM) 06:00:01.536436 run iperf3-srv_10.42.42.10(pid=32111): Terminating (SIGTERM) 06:00:01.580774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32112): Terminating (SIGTERM) 06:00:01.623458 run iperf3-srv_10.42.42.10(pid=32113): Terminating (SIGTERM) 06:00:01.665767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Terminating (SIGTERM) 06:00:01.708106 run iperf3-srv_10.42.42.10(pid=32115): Terminating (SIGTERM) 06:00:01.750349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Terminating (SIGTERM) 06:00:01.796065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Terminating (SIGTERM) 06:00:01.840589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32124): Terminating (SIGTERM) 06:00:01.883515 --- ParallelTerminationStrategy: PID 32108 died... 06:00:01.903477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminated: ok {rc=0} 06:00:01.950782 --- ParallelTerminationStrategy: PID 32109 died... 06:00:01.970612 run iperf3-srv_10.42.42.10(pid=32109): Terminated {rc=256} 06:00:02.018016 --- ParallelTerminationStrategy: PID 32110 died... 06:00:02.037799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminated: ok {rc=0} 06:00:02.086068 --- ParallelTerminationStrategy: PID 32111 died... 06:00:02.113190 run iperf3-srv_10.42.42.10(pid=32111): Terminated {rc=256} 06:00:02.169867 --- ParallelTerminationStrategy: PID 32112 died... 06:00:02.194130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32112): Terminated: ok {rc=0} 06:00:02.242300 --- ParallelTerminationStrategy: PID 32113 died... 06:00:02.262726 run iperf3-srv_10.42.42.10(pid=32113): Terminated {rc=256} 06:00:02.311065 --- ParallelTerminationStrategy: PID 32114 died... 06:00:02.330910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Terminated: ok {rc=0} 06:00:02.379003 --- ParallelTerminationStrategy: PID 32115 died... 06:00:02.398937 run iperf3-srv_10.42.42.10(pid=32115): Terminated {rc=256} 06:00:02.447435 --- ParallelTerminationStrategy: PID 32118 died... 06:00:02.467312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32118): Terminated: ok {rc=0} 06:00:02.515439 --- ParallelTerminationStrategy: PID 32121 died... 06:00:02.535515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32121): Terminated: ok {rc=0} 06:00:02.583497 --- ParallelTerminationStrategy: PID 32124 died... 06:00:02.607489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32124): Terminated: ok {rc=0} 06:00:02.700195 bus /gobi_4: Setting Powered False 06:00:03.802104 bus /gobi_4: Setting Powered False 06:00:04.916651 bus /gobi_1: Setting Powered False 06:00:06.015519 bus /gobi_1: Setting Powered False 06:00:07.131132 bus /gobi_0: Setting Powered False 06:00:08.229789 bus /gobi_0: Setting Powered False 06:00:09.345372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 06:00:10.448857 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:10.460241 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:10.510707 tst ping.py: using LAC 19417 06:00:10.628307 tst ping.py: using RAC 37 06:00:10.743540 tst ping.py: using CellId 19417 06:00:10.858026 tst ping.py: using BVCI 19418 06:00:10.973846 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:10.985033 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:10.996259 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:11.007914 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:11.019415 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:11.031125 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:11.042775 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:11.054456 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:11.169809 tst ping.py:19: start network... 06:00:11.365721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:11.817148 run create_hlr_db(pid=32170): Launched 06:00:11.929229 bus /gobi_6: Setting Powered False 06:00:12.988498 run create_hlr_db(pid=32170): Terminated: ok {rc=0} 06:00:13.397623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32172): Launched 06:00:13.689663 run osmo-hlr_10.42.42.2(pid=32173): Launched 06:00:13.806174 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:14.314942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Launched 06:00:14.606574 run osmo-stp_10.42.42.5(pid=32177): Launched 06:00:14.719113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:15.226079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Launched 06:00:15.339241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:15.585586 run patchelf(pid=32180): Launched 06:00:15.749266 run osmo-stp_10.42.42.5(pid=32177): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] 06:00:15.886220 run osmo-stp_10.42.42.5(pid=32177): stdout: | (launched: 2022-12-09_06:00:14.553234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:16.040521 run osmo-stp_10.42.42.5(pid=32177): stderr: | 20221209060014724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060014724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060014724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060014725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060014725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060014725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060014725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:16.179908 run osmo-stp_10.42.42.5(pid=32177): stdout: | (launched: 2022-12-09_06:00:14.553234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:16.313587 run osmo-stp_10.42.42.5(pid=32177): stderr: | 20221209060014724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060014724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060014724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060014725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060014725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060014725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060014725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:16.473291 run patchelf(pid=32180): Terminating (SIGINT) 06:00:16.660194 run patchelf(pid=32180): Terminated: ok {rc=0} 06:00:16.791987 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32177): Process ended prematurely: osmo-stp_10.42.42.5(pid=32177) [trial-2355↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] [trial-2355↪gprs:trx-sysmocell5000↪ping.py:22] 06:00:16.802507 tst ping.py:22: Test FAILED (6.3 sec) 06:00:16.832176 run osmo-hlr_10.42.42.2(pid=32173): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32173)] 06:00:16.884927 run osmo-hlr_10.42.42.2(pid=32173): stdout: | (launched: 2022-12-09_06:00:13.636471) 06:00:16.938252 run osmo-hlr_10.42.42.2(pid=32173): stderr: | 20221209060013820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060013820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060013820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060013820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060013820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060013820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060013837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060013847 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060013847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060013847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:16.992495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32172): Terminating (SIGTERM) 06:00:17.036684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Terminating (SIGTERM) 06:00:17.083183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Terminating (SIGTERM) 06:00:17.129094 --- ParallelTerminationStrategy: PID 32172 died... 06:00:17.149680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32172): Terminated: ok {rc=0} 06:00:17.198617 --- ParallelTerminationStrategy: PID 32176 died... 06:00:17.219040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32176): Terminated: ok {rc=0} 06:00:17.266367 --- ParallelTerminationStrategy: PID 32179 died... 06:00:17.286231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32179): Terminated: ok {rc=0} 06:00:17.374598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 06:00:18.461778 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:18.472830 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 06:00:18.522079 tst ping_idle_ping.py: using LAC 19418 06:00:18.640270 tst ping_idle_ping.py: using RAC 38 06:00:18.755764 tst ping_idle_ping.py: using CellId 19418 06:00:18.869687 tst ping_idle_ping.py: using BVCI 19419 06:00:18.977605 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:18.988372 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:18.998940 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:19.009814 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:19.020439 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:19.031209 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:19.042105 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 06:00:19.053404 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 06:00:19.166025 tst ping_idle_ping.py:24: start network... 06:00:19.362494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:19.819527 run create_hlr_db(pid=32181): Launched 06:00:19.931137 bus /gobi_6: Setting Powered False 06:00:20.990700 run create_hlr_db(pid=32181): Terminated: ok {rc=0} 06:00:21.403335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32183): Launched 06:00:21.697254 run osmo-hlr_10.42.42.2(pid=32184): Launched 06:00:21.809884 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:22.314913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32186): Launched 06:00:22.607669 run osmo-stp_10.42.42.5(pid=32187): Launched 06:00:22.720255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:23.226802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32189): Launched 06:00:23.338556 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:23.585789 run patchelf(pid=32190): Launched 06:00:23.749353 run osmo-stp_10.42.42.5(pid=32187): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32187)] 06:00:23.873931 run osmo-stp_10.42.42.5(pid=32187): stdout: | (launched: 2022-12-09_06:00:22.554175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:24.000176 run osmo-stp_10.42.42.5(pid=32187): stderr: | 20221209060022725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060022725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060022725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060022725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060022726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060022726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060022726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:24.126865 run osmo-stp_10.42.42.5(pid=32187): stdout: | (launched: 2022-12-09_06:00:22.554175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:24.247209 run osmo-stp_10.42.42.5(pid=32187): stderr: | 20221209060022725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060022725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060022725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060022725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060022726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060022726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060022726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:24.389524 run patchelf(pid=32190): Terminating (SIGINT) 06:00:24.555127 run patchelf(pid=32190): Terminated: ok {rc=0} 06:00:24.674437 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32187): Process ended prematurely: osmo-stp_10.42.42.5(pid=32187) [trial-2355↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32187)] [trial-2355↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 06:00:24.683641 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 06:00:24.710843 run osmo-hlr_10.42.42.2(pid=32184): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32184)] 06:00:24.758903 run osmo-hlr_10.42.42.2(pid=32184): stdout: | (launched: 2022-12-09_06:00:21.643474) 06:00:24.808847 run osmo-hlr_10.42.42.2(pid=32184): stderr: | 20221209060021816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060021816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060021816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060021816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060021816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060021816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060021829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060021839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060021840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060021840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:24.859427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32183): Terminating (SIGTERM) 06:00:24.899909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32186): Terminating (SIGTERM) 06:00:24.940391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32189): Terminating (SIGTERM) 06:00:24.981022 --- ParallelTerminationStrategy: PID 32183 died... 06:00:25.000025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32183): Terminated: ok {rc=0} 06:00:25.044765 --- ParallelTerminationStrategy: PID 32186 died... 06:00:25.063382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32186): Terminated: ok {rc=0} 06:00:25.108151 --- ParallelTerminationStrategy: PID 32189 died... 06:00:25.126834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32189): Terminated: ok {rc=0} 06:00:25.211634 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 06:00:26.523967 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:00:26.530141 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:00:26.566185 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:00:26.605759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:00:26.694580 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:00:26.729276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:00:26.768540 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:00:27.365110 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:00:27.417594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:27.428836 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:27.482230 tst cs_paging_gprs_active.py: using LAC 19419 06:00:27.605784 tst cs_paging_gprs_active.py: using RAC 39 06:00:27.723090 tst cs_paging_gprs_active.py: using CellId 19419 06:00:27.839407 tst cs_paging_gprs_active.py: using BVCI 19420 06:00:27.948445 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:27.959559 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:27.970325 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:27.981258 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:27.991907 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:28.002759 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:28.013776 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:28.024643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:28.035622 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:28.153543 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:28.268370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:00:28.470382 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:28.771207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32195): Launched 06:00:29.032500 run iperf3-srv_10.42.42.10(pid=32196): Launched 06:00:29.145388 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:00:29.345752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:29.646399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32197): Launched 06:00:29.907181 run iperf3-srv_10.42.42.10(pid=32198): Launched 06:00:30.020103 tst cs_paging_gprs_active.py:38: start network... 06:00:30.220473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:30.685978 run create_hlr_db(pid=32199): Launched 06:00:30.801309 bus /gobi_6: Setting Powered False 06:00:31.877276 run create_hlr_db(pid=32199): Terminated: ok {rc=0} 06:00:32.381527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Launched 06:00:32.681498 run osmo-hlr_10.42.42.2(pid=32202): Launched 06:00:32.796288 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:33.329152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Launched 06:00:33.627815 run osmo-stp_10.42.42.5(pid=32205): Launched 06:00:33.742014 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:34.257946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32207): Launched 06:00:34.372558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:34.624813 run patchelf(pid=32208): Launched 06:00:34.792255 run osmo-stp_10.42.42.5(pid=32205): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] 06:00:34.919864 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-09_06:00:33.572941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:35.048352 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221209060033743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060033743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060033743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060033744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060033744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060033744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060033744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:35.177160 run osmo-stp_10.42.42.5(pid=32205): stdout: | (launched: 2022-12-09_06:00:33.572941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:35.300349 run osmo-stp_10.42.42.5(pid=32205): stderr: | 20221209060033743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060033743 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060033743 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060033744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060033744 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060033744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060033744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:35.446694 run patchelf(pid=32208): Terminating (SIGINT) 06:00:35.615225 run patchelf(pid=32208): Terminated: ok {rc=0} 06:00:35.736821 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:00:35.746402 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:00:35.773772 run osmo-hlr_10.42.42.2(pid=32202): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32202)] 06:00:35.821930 run osmo-hlr_10.42.42.2(pid=32202): stdout: | (launched: 2022-12-09_06:00:32.626509) 06:00:35.871635 run osmo-hlr_10.42.42.2(pid=32202): stderr: | 20221209060032805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060032805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060032805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060032805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060032805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060032805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060032818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060032826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060032826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060032827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:35.921839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32195): Terminating (SIGTERM) 06:00:35.962170 run iperf3-srv_10.42.42.10(pid=32196): Terminating (SIGTERM) 06:00:36.002322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32197): Terminating (SIGTERM) 06:00:36.042696 run iperf3-srv_10.42.42.10(pid=32198): Terminating (SIGTERM) 06:00:36.083089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminating (SIGTERM) 06:00:36.123493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminating (SIGTERM) 06:00:36.163674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32207): Terminating (SIGTERM) 06:00:36.203881 --- ParallelTerminationStrategy: PID 32195 died... 06:00:36.223008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32195): Terminated: ok {rc=0} 06:00:36.268202 --- ParallelTerminationStrategy: PID 32196 died... 06:00:36.286935 run iperf3-srv_10.42.42.10(pid=32196): Terminated {rc=256} 06:00:36.331407 --- ParallelTerminationStrategy: PID 32197 died... 06:00:36.349975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32197): Terminated: ok {rc=0} 06:00:36.394151 --- ParallelTerminationStrategy: PID 32198 died... 06:00:36.412646 run iperf3-srv_10.42.42.10(pid=32198): Terminated {rc=256} 06:00:36.457095 --- ParallelTerminationStrategy: PID 32201 died... 06:00:36.475635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32201): Terminated: ok {rc=0} 06:00:36.519987 --- ParallelTerminationStrategy: PID 32204 died... 06:00:36.538660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32204): Terminated: ok {rc=0} 06:00:36.583018 --- ParallelTerminationStrategy: PID 32207 died... 06:00:36.601618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32207): Terminated: ok {rc=0} 06:00:36.685045 bus /gobi_0: Setting Powered False 06:00:37.783377 bus /gobi_0: Setting Powered False 06:00:38.900247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:00:40.051225 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.063244 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:40.118195 tst iperf3.py: using LAC 19420 06:00:40.245716 tst iperf3.py: using RAC 40 06:00:40.372842 tst iperf3.py: using CellId 19420 06:00:40.500334 tst iperf3.py: using BVCI 19421 06:00:40.609393 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.620201 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.630855 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.641787 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.652738 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.663632 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.674583 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.685389 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:40.696432 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:40.813732 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:41.031015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:41.351666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32209): Launched 06:00:41.629654 run iperf3-srv_10.42.42.10(pid=32210): Launched 06:00:41.749887 tst iperf3.py:8: start network... 06:00:41.965823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:42.462632 run create_hlr_db(pid=32211): Launched 06:00:42.593344 bus /gobi_6: Setting Powered False 06:00:43.656558 run create_hlr_db(pid=32211): Terminated: ok {rc=0} 06:00:44.083173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Launched 06:00:44.380120 run osmo-hlr_10.42.42.2(pid=32214): Launched 06:00:44.493543 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:45.022732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Launched 06:00:45.320738 run osmo-stp_10.42.42.5(pid=32217): Launched 06:00:45.434255 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:45.973931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32219): Launched 06:00:46.102916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:46.375705 run patchelf(pid=32220): Launched 06:00:46.550717 run osmo-stp_10.42.42.5(pid=32217): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] 06:00:46.681984 run osmo-stp_10.42.42.5(pid=32217): stdout: | (launched: 2022-12-09_06:00:45.266360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:46.814578 run osmo-stp_10.42.42.5(pid=32217): stderr: | 20221209060045436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060045436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060045436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060045437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060045437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060045437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060045437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:46.948172 run osmo-stp_10.42.42.5(pid=32217): stdout: | (launched: 2022-12-09_06:00:45.266360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:47.075667 run osmo-stp_10.42.42.5(pid=32217): stderr: | 20221209060045436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060045436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060045436 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060045437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060045437 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060045437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060045437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:47.226227 run patchelf(pid=32220): Terminating (SIGINT) 06:00:47.395121 run patchelf(pid=32220): Terminated: ok {rc=0} 06:00:47.517249 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32217): Process ended prematurely: osmo-stp_10.42.42.5(pid=32217) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 06:00:47.526750 tst iperf3.py:8: Test FAILED (7.5 sec) 06:00:47.555359 run osmo-hlr_10.42.42.2(pid=32214): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32214)] 06:00:47.604609 run osmo-hlr_10.42.42.2(pid=32214): stdout: | (launched: 2022-12-09_06:00:44.326025) 06:00:47.655579 run osmo-hlr_10.42.42.2(pid=32214): stderr: | 20221209060044501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060044501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060044501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060044501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060044501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060044501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060044512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060044521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060044521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060044521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:47.706935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32209): Terminating (SIGTERM) 06:00:47.747367 run iperf3-srv_10.42.42.10(pid=32210): Terminating (SIGTERM) 06:00:47.789146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Terminating (SIGTERM) 06:00:47.830562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Terminating (SIGTERM) 06:00:47.871574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32219): Terminating (SIGTERM) 06:00:47.912555 --- ParallelTerminationStrategy: PID 32209 died... 06:00:47.931700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32209): Terminated: ok {rc=0} 06:00:47.977679 --- ParallelTerminationStrategy: PID 32210 died... 06:00:47.996306 run iperf3-srv_10.42.42.10(pid=32210): Terminated {rc=256} 06:00:48.042114 --- ParallelTerminationStrategy: PID 32213 died... 06:00:48.060720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Terminated: ok {rc=0} 06:00:48.106689 --- ParallelTerminationStrategy: PID 32216 died... 06:00:48.125488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Terminated: ok {rc=0} 06:00:48.171045 --- ParallelTerminationStrategy: PID 32219 died... 06:00:48.189688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32219): Terminated: ok {rc=0} 06:00:48.274898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:00:49.423352 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.435219 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:00:49.488854 tst iperf3m4.py: using LAC 19421 06:00:49.616072 tst iperf3m4.py: using RAC 41 06:00:49.742705 tst iperf3m4.py: using CellId 19421 06:00:49.870309 tst iperf3m4.py: using BVCI 19422 06:00:49.987441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:49.998885 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.010227 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.021560 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.032633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.043770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.055116 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.066282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:00:50.077556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:50.197775 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:50.314465 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:50.433703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:00:50.549750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:00:50.749832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:51.048795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32221): Launched 06:00:51.308479 run iperf3-srv_10.42.42.10(pid=32222): Launched 06:00:51.420852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:00:51.621293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:51.920941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32223): Launched 06:00:52.181333 run iperf3-srv_10.42.42.10(pid=32224): Launched 06:00:52.293464 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:00:52.492808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:52.792076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32225): Launched 06:00:53.052782 run iperf3-srv_10.42.42.10(pid=32226): Launched 06:00:53.164842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:00:53.364608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:00:53.664419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32227): Launched 06:00:53.924756 run iperf3-srv_10.42.42.10(pid=32228): Launched 06:00:54.037067 tst iperf3m4.py:8: start network... 06:00:54.236831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:00:54.700603 run create_hlr_db(pid=32229): Launched 06:00:54.815846 bus /gobi_6: Setting Powered False 06:00:55.880420 run create_hlr_db(pid=32229): Terminated: ok {rc=0} 06:00:56.309264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32231): Launched 06:00:56.607860 run osmo-hlr_10.42.42.2(pid=32232): Launched 06:00:56.723852 run osmo-stp_10.42.42.5: Starting osmo-stp 06:00:57.239418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32234): Launched 06:00:57.538906 run osmo-stp_10.42.42.5(pid=32235): Launched 06:00:57.652337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:00:58.166665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32237): Launched 06:00:58.280748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:00:58.533204 run patchelf(pid=32238): Launched 06:00:58.699516 run osmo-stp_10.42.42.5(pid=32235): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32235)] 06:00:58.826535 run osmo-stp_10.42.42.5(pid=32235): stdout: | (launched: 2022-12-09_06:00:57.483551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:58.955131 run osmo-stp_10.42.42.5(pid=32235): stderr: | 20221209060057651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060057651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060057651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060057651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060057652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060057652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060057652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:59.083956 run osmo-stp_10.42.42.5(pid=32235): stdout: | (launched: 2022-12-09_06:00:57.483551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:00:59.207496 run osmo-stp_10.42.42.5(pid=32235): stderr: | 20221209060057651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060057651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060057651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060057651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060057652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060057652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060057652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:00:59.354054 run patchelf(pid=32238): Terminating (SIGINT) 06:00:59.522505 run patchelf(pid=32238): Terminated: ok {rc=0} 06:00:59.643985 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32235): Process ended prematurely: osmo-stp_10.42.42.5(pid=32235) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32235)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 06:00:59.653514 tst iperf3m4.py:8: Test FAILED (10.3 sec) 06:00:59.681399 run osmo-hlr_10.42.42.2(pid=32232): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32232)] 06:00:59.729538 run osmo-hlr_10.42.42.2(pid=32232): stdout: | (launched: 2022-12-09_06:00:56.553470) 06:00:59.779643 run osmo-hlr_10.42.42.2(pid=32232): stderr: | 20221209060056729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060056729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060056729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060056729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060056729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060056729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060056741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060056749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060056749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060056749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:00:59.830311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32221): Terminating (SIGTERM) 06:00:59.870682 run iperf3-srv_10.42.42.10(pid=32222): Terminating (SIGTERM) 06:00:59.910971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32223): Terminating (SIGTERM) 06:00:59.951642 run iperf3-srv_10.42.42.10(pid=32224): Terminating (SIGTERM) 06:00:59.991733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32225): Terminating (SIGTERM) 06:01:00.032070 run iperf3-srv_10.42.42.10(pid=32226): Terminating (SIGTERM) 06:01:00.072289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32227): Terminating (SIGTERM) 06:01:00.112582 run iperf3-srv_10.42.42.10(pid=32228): Terminating (SIGTERM) 06:01:00.152560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32231): Terminating (SIGTERM) 06:01:00.192567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32234): Terminating (SIGTERM) 06:01:00.232806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32237): Terminating (SIGTERM) 06:01:00.273197 --- ParallelTerminationStrategy: PID 32221 died... 06:01:00.292345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32221): Terminated: ok {rc=0} 06:01:00.336914 --- ParallelTerminationStrategy: PID 32222 died... 06:01:00.355529 run iperf3-srv_10.42.42.10(pid=32222): Terminated {rc=256} 06:01:00.399801 --- ParallelTerminationStrategy: PID 32223 died... 06:01:00.418359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32223): Terminated: ok {rc=0} 06:01:00.463073 --- ParallelTerminationStrategy: PID 32224 died... 06:01:00.481616 run iperf3-srv_10.42.42.10(pid=32224): Terminated {rc=256} 06:01:00.525809 --- ParallelTerminationStrategy: PID 32225 died... 06:01:00.544295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32225): Terminated: ok {rc=0} 06:01:00.588667 --- ParallelTerminationStrategy: PID 32226 died... 06:01:00.607192 run iperf3-srv_10.42.42.10(pid=32226): Terminated {rc=256} 06:01:00.651314 --- ParallelTerminationStrategy: PID 32227 died... 06:01:00.669858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32227): Terminated: ok {rc=0} 06:01:00.713920 --- ParallelTerminationStrategy: PID 32228 died... 06:01:00.732362 run iperf3-srv_10.42.42.10(pid=32228): Terminated {rc=256} 06:01:00.776783 --- ParallelTerminationStrategy: PID 32231 died... 06:01:00.795253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32231): Terminated: ok {rc=0} 06:01:00.840063 --- ParallelTerminationStrategy: PID 32234 died... 06:01:00.859127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32234): Terminated: ok {rc=0} 06:01:00.904208 --- ParallelTerminationStrategy: PID 32237 died... 06:01:00.923785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32237): Terminated: ok {rc=0} 06:01:01.018005 bus /gobi_4: Setting Powered False 06:01:02.129036 bus /gobi_4: Setting Powered False 06:01:03.259629 bus /gobi_1: Setting Powered False 06:01:04.359144 bus /gobi_1: Setting Powered False 06:01:05.475366 bus /gobi_0: Setting Powered False 06:01:06.574139 bus /gobi_0: Setting Powered False 06:01:07.691173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 06:01:08.794668 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:08.806892 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:08.859242 tst ping.py: using LAC 19422 06:01:08.976457 tst ping.py: using RAC 42 06:01:09.106624 tst ping.py: using CellId 19422 06:01:09.230785 tst ping.py: using BVCI 19423 06:01:09.346658 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.358143 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.369428 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.380576 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.391740 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.402856 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.414270 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:09.425498 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:09.542413 tst ping.py:19: start network... 06:01:09.754266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:10.240233 run create_hlr_db(pid=32239): Launched 06:01:10.367745 bus /gobi_6: Setting Powered False 06:01:11.429955 run create_hlr_db(pid=32239): Terminated: ok {rc=0} 06:01:11.849936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Launched 06:01:12.143227 run osmo-hlr_10.42.42.2(pid=32242): Launched 06:01:12.254669 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:12.775295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Launched 06:01:13.067582 run osmo-stp_10.42.42.5(pid=32245): Launched 06:01:13.178206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:13.681922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32247): Launched 06:01:13.794328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:14.041436 run patchelf(pid=32248): Launched 06:01:14.204937 run osmo-stp_10.42.42.5(pid=32245): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] 06:01:14.330347 run osmo-stp_10.42.42.5(pid=32245): stdout: | (launched: 2022-12-09_06:01:13.014444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:14.457538 run osmo-stp_10.42.42.5(pid=32245): stderr: | 20221209060113183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060113183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060113184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060113184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060113184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060113185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060113185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:14.584616 run osmo-stp_10.42.42.5(pid=32245): stdout: | (launched: 2022-12-09_06:01:13.014444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:14.705724 run osmo-stp_10.42.42.5(pid=32245): stderr: | 20221209060113183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060113183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060113184 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060113184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060113184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060113185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060113185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:14.848663 run patchelf(pid=32248): Terminating (SIGINT) 06:01:15.014612 run patchelf(pid=32248): Terminated: ok {rc=0} 06:01:15.134345 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32245): Process ended prematurely: osmo-stp_10.42.42.5(pid=32245) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 06:01:15.142995 tst ping.py:22: Test FAILED (6.3 sec) 06:01:15.169836 run osmo-hlr_10.42.42.2(pid=32242): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32242)] 06:01:15.217844 run osmo-hlr_10.42.42.2(pid=32242): stdout: | (launched: 2022-12-09_06:01:12.089831) 06:01:15.266945 run osmo-hlr_10.42.42.2(pid=32242): stderr: | 20221209060112266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060112266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060112266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060112266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060112266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060112266 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060112288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060112298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060112298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060112298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:15.316599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Terminating (SIGTERM) 06:01:15.356373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Terminating (SIGTERM) 06:01:15.396328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32247): Terminating (SIGTERM) 06:01:15.436638 --- ParallelTerminationStrategy: PID 32241 died... 06:01:15.455797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32241): Terminated: ok {rc=0} 06:01:15.500631 --- ParallelTerminationStrategy: PID 32244 died... 06:01:15.519437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32244): Terminated: ok {rc=0} 06:01:15.563817 --- ParallelTerminationStrategy: PID 32247 died... 06:01:15.582569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32247): Terminated: ok {rc=0} 06:01:15.670069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:01:16.760888 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:16.773433 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:01:16.829223 tst ping_idle_ping.py: using LAC 19423 06:01:16.954732 tst ping_idle_ping.py: using RAC 43 06:01:17.109471 tst ping_idle_ping.py: using CellId 19423 06:01:17.238628 tst ping_idle_ping.py: using BVCI 19424 06:01:17.354028 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.365522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.376641 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.387889 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.399033 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.410196 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.421678 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:01:17.432804 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:01:17.547726 tst ping_idle_ping.py:24: start network... 06:01:17.743586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:18.201061 run create_hlr_db(pid=32249): Launched 06:01:18.313393 bus /gobi_6: Setting Powered False 06:01:19.372824 run create_hlr_db(pid=32249): Terminated: ok {rc=0} 06:01:19.784573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Launched 06:01:20.078648 run osmo-hlr_10.42.42.2(pid=32252): Launched 06:01:20.190158 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:20.710322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Launched 06:01:21.003411 run osmo-stp_10.42.42.5(pid=32255): Launched 06:01:21.114545 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:21.621907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32257): Launched 06:01:21.734878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:21.983207 run patchelf(pid=32258): Launched 06:01:22.147752 run osmo-stp_10.42.42.5(pid=32255): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] 06:01:22.273360 run osmo-stp_10.42.42.5(pid=32255): stdout: | (launched: 2022-12-09_06:01:20.949964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:22.400238 run osmo-stp_10.42.42.5(pid=32255): stderr: | 20221209060121120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060121120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060121120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060121120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060121121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060121121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060121121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:22.527678 run osmo-stp_10.42.42.5(pid=32255): stdout: | (launched: 2022-12-09_06:01:20.949964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:22.648578 run osmo-stp_10.42.42.5(pid=32255): stderr: | 20221209060121120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060121120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060121120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060121120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060121121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060121121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060121121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:22.791798 run patchelf(pid=32258): Terminating (SIGINT) 06:01:22.957751 run patchelf(pid=32258): Terminated: ok {rc=0} 06:01:23.077272 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32255): Process ended prematurely: osmo-stp_10.42.42.5(pid=32255) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 06:01:23.086083 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:01:23.112917 run osmo-hlr_10.42.42.2(pid=32252): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32252)] 06:01:23.161640 run osmo-hlr_10.42.42.2(pid=32252): stdout: | (launched: 2022-12-09_06:01:20.024819) 06:01:23.211479 run osmo-hlr_10.42.42.2(pid=32252): stderr: | 20221209060120201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060120201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060120202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060120202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060120202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060120202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060120214 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060120222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060120222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060120222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:23.261796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Terminating (SIGTERM) 06:01:23.302037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Terminating (SIGTERM) 06:01:23.342068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32257): Terminating (SIGTERM) 06:01:23.382512 --- ParallelTerminationStrategy: PID 32251 died... 06:01:23.401660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32251): Terminated: ok {rc=0} 06:01:23.446758 --- ParallelTerminationStrategy: PID 32254 died... 06:01:23.465505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32254): Terminated: ok {rc=0} 06:01:23.510123 --- ParallelTerminationStrategy: PID 32257 died... 06:01:23.528997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32257): Terminated: ok {rc=0} 06:01:23.615604 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:01:24.930882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:01:24.937481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:01:24.971698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:01:25.010900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:01:25.097824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:01:25.131792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:01:25.170898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:01:25.770822 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:01:25.821787 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:25.833087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:25.904232 tst cs_paging_gprs_active.py: using LAC 19424 06:01:26.031987 tst cs_paging_gprs_active.py: using RAC 44 06:01:26.152575 tst cs_paging_gprs_active.py: using CellId 19424 06:01:26.278684 tst cs_paging_gprs_active.py: using BVCI 19425 06:01:26.394664 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.406092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.417241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.428383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.439566 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.450650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.461871 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.472846 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:26.484183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:26.602204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:26.723801 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:01:26.940040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:27.262743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32263): Launched 06:01:27.540726 run iperf3-srv_10.42.42.10(pid=32264): Launched 06:01:27.660770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:01:27.876633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:28.197575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32265): Launched 06:01:28.475536 run iperf3-srv_10.42.42.10(pid=32266): Launched 06:01:28.595948 tst cs_paging_gprs_active.py:38: start network... 06:01:28.811913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:29.311077 run create_hlr_db(pid=32267): Launched 06:01:29.442160 bus /gobi_6: Setting Powered False 06:01:30.504489 run create_hlr_db(pid=32267): Terminated: ok {rc=0} 06:01:30.971135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32269): Launched 06:01:31.313856 run osmo-hlr_10.42.42.2(pid=32270): Launched 06:01:31.549639 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:32.219547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32272): Launched 06:01:32.551870 run osmo-stp_10.42.42.5(pid=32273): Launched 06:01:32.673715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:33.230232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32275): Launched 06:01:33.353906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:33.624807 run patchelf(pid=32276): Launched 06:01:33.803051 run osmo-stp_10.42.42.5(pid=32273): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32273)] 06:01:33.939478 run osmo-stp_10.42.42.5(pid=32273): stdout: | (launched: 2022-12-09_06:01:32.494065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:34.078291 run osmo-stp_10.42.42.5(pid=32273): stderr: | 20221209060132686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060132686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060132686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060132687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060132689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060132689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060132690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:34.215881 run osmo-stp_10.42.42.5(pid=32273): stdout: | (launched: 2022-12-09_06:01:32.494065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:34.348120 run osmo-stp_10.42.42.5(pid=32273): stderr: | 20221209060132686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060132686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060132686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060132687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060132689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060132689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060132690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:34.504393 run patchelf(pid=32276): Terminating (SIGINT) 06:01:34.684419 run patchelf(pid=32276): Terminated: ok {rc=0} 06:01:34.814652 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32273): Process ended prematurely: osmo-stp_10.42.42.5(pid=32273) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32273)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:01:34.824532 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 06:01:34.852771 run osmo-hlr_10.42.42.2(pid=32270): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32270)] 06:01:34.902756 run osmo-hlr_10.42.42.2(pid=32270): stdout: | (launched: 2022-12-09_06:01:31.249238) 06:01:34.954537 run osmo-hlr_10.42.42.2(pid=32270): stderr: | 20221209060131447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060131447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060131447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060131447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060131447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060131447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060131464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060131487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060131487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060131487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:35.006998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32263): Terminating (SIGTERM) 06:01:35.048831 run iperf3-srv_10.42.42.10(pid=32264): Terminating (SIGTERM) 06:01:35.091097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32265): Terminating (SIGTERM) 06:01:35.132810 run iperf3-srv_10.42.42.10(pid=32266): Terminating (SIGTERM) 06:01:35.174478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32269): Terminating (SIGTERM) 06:01:35.216172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32272): Terminating (SIGTERM) 06:01:35.258433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32275): Terminating (SIGTERM) 06:01:35.300616 --- ParallelTerminationStrategy: PID 32263 died... 06:01:35.320611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32263): Terminated: ok {rc=0} 06:01:35.366607 --- ParallelTerminationStrategy: PID 32264 died... 06:01:35.385892 run iperf3-srv_10.42.42.10(pid=32264): Terminated {rc=256} 06:01:35.431641 --- ParallelTerminationStrategy: PID 32265 died... 06:01:35.451050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32265): Terminated: ok {rc=0} 06:01:35.496775 --- ParallelTerminationStrategy: PID 32266 died... 06:01:35.516167 run iperf3-srv_10.42.42.10(pid=32266): Terminated {rc=256} 06:01:35.561835 --- ParallelTerminationStrategy: PID 32269 died... 06:01:35.581306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32269): Terminated: ok {rc=0} 06:01:35.627145 --- ParallelTerminationStrategy: PID 32272 died... 06:01:35.646616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32272): Terminated: ok {rc=0} 06:01:35.692627 --- ParallelTerminationStrategy: PID 32275 died... 06:01:35.712181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32275): Terminated: ok {rc=0} 06:01:35.799252 bus /gobi_0: Setting Powered False 06:01:36.899275 bus /gobi_0: Setting Powered False 06:01:38.014545 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:01:39.163741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.175715 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:39.252298 tst iperf3.py: using LAC 19425 06:01:39.370352 tst iperf3.py: using RAC 45 06:01:39.488148 tst iperf3.py: using CellId 19425 06:01:39.604224 tst iperf3.py: using BVCI 19426 06:01:39.712485 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.723510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.734500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.745536 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.756301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.767307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.778438 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.789399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:39.800426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:39.918001 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:40.134420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:40.454016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32277): Launched 06:01:40.731567 run iperf3-srv_10.42.42.10(pid=32278): Launched 06:01:40.846103 tst iperf3.py:8: start network... 06:01:41.045442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:41.509334 run create_hlr_db(pid=32279): Launched 06:01:41.623582 bus /gobi_6: Setting Powered False 06:01:42.683073 run create_hlr_db(pid=32279): Terminated: ok {rc=0} 06:01:43.120536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32281): Launched 06:01:43.441316 run osmo-hlr_10.42.42.2(pid=32282): Launched 06:01:43.563642 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:44.120164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32284): Launched 06:01:44.439480 run osmo-stp_10.42.42.5(pid=32285): Launched 06:01:44.560417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:45.115262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32287): Launched 06:01:45.238559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:45.510067 run patchelf(pid=32288): Launched 06:01:45.689191 run osmo-stp_10.42.42.5(pid=32285): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32285)] 06:01:45.825515 run osmo-stp_10.42.42.5(pid=32285): stdout: | (launched: 2022-12-09_06:01:44.381837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:45.974426 run osmo-stp_10.42.42.5(pid=32285): stderr: | 20221209060144573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060144574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060144574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060144574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060144576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060144577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060144577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:46.127179 run osmo-stp_10.42.42.5(pid=32285): stdout: | (launched: 2022-12-09_06:01:44.381837) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:46.262698 run osmo-stp_10.42.42.5(pid=32285): stderr: | 20221209060144573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060144574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060144574 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060144574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060144576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060144577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060144577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:46.422937 run patchelf(pid=32288): Terminating (SIGINT) 06:01:46.606416 run patchelf(pid=32288): Terminated: ok {rc=0} 06:01:46.739149 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32285): Process ended prematurely: osmo-stp_10.42.42.5(pid=32285) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32285)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 06:01:46.749800 tst iperf3.py:8: Test FAILED (7.6 sec) 06:01:46.779326 run osmo-hlr_10.42.42.2(pid=32282): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32282)] 06:01:46.830290 run osmo-hlr_10.42.42.2(pid=32282): stdout: | (launched: 2022-12-09_06:01:43.383307) 06:01:46.883000 run osmo-hlr_10.42.42.2(pid=32282): stderr: | 20221209060143583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060143583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060143583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060143583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060143583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060143583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060143595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060143604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060143604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060143604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:46.936330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32277): Terminating (SIGTERM) 06:01:46.979524 run iperf3-srv_10.42.42.10(pid=32278): Terminating (SIGTERM) 06:01:47.025418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32281): Terminating (SIGTERM) 06:01:47.068273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32284): Terminating (SIGTERM) 06:01:47.110880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32287): Terminating (SIGTERM) 06:01:47.153473 --- ParallelTerminationStrategy: PID 32277 died... 06:01:47.173324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32277): Terminated: ok {rc=0} 06:01:47.220064 --- ParallelTerminationStrategy: PID 32278 died... 06:01:47.240047 run iperf3-srv_10.42.42.10(pid=32278): Terminated {rc=256} 06:01:47.285882 --- ParallelTerminationStrategy: PID 32281 died... 06:01:47.305488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32281): Terminated: ok {rc=0} 06:01:47.351709 --- ParallelTerminationStrategy: PID 32284 died... 06:01:47.371332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32284): Terminated: ok {rc=0} 06:01:47.417376 --- ParallelTerminationStrategy: PID 32287 died... 06:01:47.436862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32287): Terminated: ok {rc=0} 06:01:47.524570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:01:48.670112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:48.681899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:01:48.751363 tst iperf3m4.py: using LAC 19426 06:01:48.878270 tst iperf3m4.py: using RAC 46 06:01:49.003446 tst iperf3m4.py: using CellId 19426 06:01:49.121040 tst iperf3m4.py: using BVCI 19427 06:01:49.230721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.241923 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.252721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.263742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.274786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.285869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.296936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.307800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:01:49.318868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:49.434049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:49.550855 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:49.670735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:01:49.790652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:01:50.007388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:50.329342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32289): Launched 06:01:50.608503 run iperf3-srv_10.42.42.10(pid=32290): Launched 06:01:50.730391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:01:50.946311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:51.268149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32291): Launched 06:01:51.547523 run iperf3-srv_10.42.42.10(pid=32292): Launched 06:01:51.667641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:01:51.883843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:52.205349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32293): Launched 06:01:52.485828 run iperf3-srv_10.42.42.10(pid=32294): Launched 06:01:52.607780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:01:52.824142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:01:53.146779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32295): Launched 06:01:53.426437 run iperf3-srv_10.42.42.10(pid=32296): Launched 06:01:53.546439 tst iperf3m4.py:8: start network... 06:01:53.762230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:01:54.260061 run create_hlr_db(pid=32297): Launched 06:01:54.390514 bus /gobi_6: Setting Powered False 06:01:55.454505 run create_hlr_db(pid=32297): Terminated: ok {rc=0} 06:01:55.883271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Launched 06:01:56.183059 run osmo-hlr_10.42.42.2(pid=32300): Launched 06:01:56.297372 run osmo-stp_10.42.42.5: Starting osmo-stp 06:01:56.817248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Launched 06:01:57.116559 run osmo-stp_10.42.42.5(pid=32303): Launched 06:01:57.230729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:01:57.747078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Launched 06:01:57.861532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:01:58.114727 run patchelf(pid=32306): Launched 06:01:58.281197 run osmo-stp_10.42.42.5(pid=32303): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] 06:01:58.408506 run osmo-stp_10.42.42.5(pid=32303): stdout: | (launched: 2022-12-09_06:01:57.061941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:58.537624 run osmo-stp_10.42.42.5(pid=32303): stderr: | 20221209060157230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060157230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060157230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060157231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060157231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060157231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060157231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:58.666589 run osmo-stp_10.42.42.5(pid=32303): stdout: | (launched: 2022-12-09_06:01:57.061941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:01:58.790754 run osmo-stp_10.42.42.5(pid=32303): stderr: | 20221209060157230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060157230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060157230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060157231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060157231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060157231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060157231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:01:58.937554 run patchelf(pid=32306): Terminating (SIGINT) 06:01:59.106340 run patchelf(pid=32306): Terminated: ok {rc=0} 06:01:59.227723 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32303): Process ended prematurely: osmo-stp_10.42.42.5(pid=32303) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:01:59.237312 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:01:59.265214 run osmo-hlr_10.42.42.2(pid=32300): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32300)] 06:01:59.313314 run osmo-hlr_10.42.42.2(pid=32300): stdout: | (launched: 2022-12-09_06:01:56.128288) 06:01:59.363437 run osmo-hlr_10.42.42.2(pid=32300): stderr: | 20221209060156304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060156304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060156304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060156304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060156304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060156305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060156316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060156326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060156326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060156326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:01:59.413678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32289): Terminating (SIGTERM) 06:01:59.454426 run iperf3-srv_10.42.42.10(pid=32290): Terminating (SIGTERM) 06:01:59.494594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32291): Terminating (SIGTERM) 06:01:59.534836 run iperf3-srv_10.42.42.10(pid=32292): Terminating (SIGTERM) 06:01:59.574964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32293): Terminating (SIGTERM) 06:01:59.615251 run iperf3-srv_10.42.42.10(pid=32294): Terminating (SIGTERM) 06:01:59.655299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32295): Terminating (SIGTERM) 06:01:59.695418 run iperf3-srv_10.42.42.10(pid=32296): Terminating (SIGTERM) 06:01:59.735525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Terminating (SIGTERM) 06:01:59.775560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Terminating (SIGTERM) 06:01:59.815573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Terminating (SIGTERM) 06:01:59.855911 --- ParallelTerminationStrategy: PID 32289 died... 06:01:59.874968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32289): Terminated: ok {rc=0} 06:01:59.919705 --- ParallelTerminationStrategy: PID 32290 died... 06:01:59.938369 run iperf3-srv_10.42.42.10(pid=32290): Terminated {rc=256} 06:01:59.982381 --- ParallelTerminationStrategy: PID 32291 died... 06:02:00.001025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32291): Terminated: ok {rc=0} 06:02:00.045872 --- ParallelTerminationStrategy: PID 32292 died... 06:02:00.064398 run iperf3-srv_10.42.42.10(pid=32292): Terminated {rc=256} 06:02:00.108618 --- ParallelTerminationStrategy: PID 32293 died... 06:02:00.127555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32293): Terminated: ok {rc=0} 06:02:00.172278 --- ParallelTerminationStrategy: PID 32294 died... 06:02:00.191037 run iperf3-srv_10.42.42.10(pid=32294): Terminated {rc=256} 06:02:00.235246 --- ParallelTerminationStrategy: PID 32295 died... 06:02:00.253990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32295): Terminated: ok {rc=0} 06:02:00.298619 --- ParallelTerminationStrategy: PID 32296 died... 06:02:00.317229 run iperf3-srv_10.42.42.10(pid=32296): Terminated {rc=256} 06:02:00.361622 --- ParallelTerminationStrategy: PID 32299 died... 06:02:00.380230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Terminated: ok {rc=0} 06:02:00.424681 --- ParallelTerminationStrategy: PID 32302 died... 06:02:00.443595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Terminated: ok {rc=0} 06:02:00.488763 --- ParallelTerminationStrategy: PID 32305 died... 06:02:00.507499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Terminated: ok {rc=0} 06:02:00.593751 bus /gobi_4: Setting Powered False 06:02:01.721457 bus /gobi_4: Setting Powered False 06:02:02.852624 bus /gobi_1: Setting Powered False 06:02:03.952127 bus /gobi_1: Setting Powered False 06:02:05.070455 bus /gobi_0: Setting Powered False 06:02:06.169638 bus /gobi_0: Setting Powered False 06:02:07.285265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:02:08.389596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:08.401725 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:08.474261 tst ping.py: using LAC 19427 06:02:08.599781 tst ping.py: using RAC 47 06:02:08.723164 tst ping.py: using CellId 19427 06:02:08.848548 tst ping.py: using BVCI 19428 06:02:08.963198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:08.974792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:08.986284 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:08.998199 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:09.009645 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:09.021058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:09.032512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:09.043974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:09.161118 tst ping.py:19: start network... 06:02:09.372124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:09.858532 run create_hlr_db(pid=32307): Launched 06:02:09.985915 bus /gobi_6: Setting Powered False 06:02:11.048410 run create_hlr_db(pid=32307): Terminated: ok {rc=0} 06:02:11.466865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32309): Launched 06:02:11.759637 run osmo-hlr_10.42.42.2(pid=32310): Launched 06:02:11.870536 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:12.375874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32312): Launched 06:02:12.667079 run osmo-stp_10.42.42.5(pid=32313): Launched 06:02:12.778520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:13.281892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32315): Launched 06:02:13.394353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:13.641793 run patchelf(pid=32316): Launched 06:02:13.805793 run osmo-stp_10.42.42.5(pid=32313): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32313)] 06:02:13.931595 run osmo-stp_10.42.42.5(pid=32313): stdout: | (launched: 2022-12-09_06:02:12.613908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:14.058411 run osmo-stp_10.42.42.5(pid=32313): stderr: | 20221209060212779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060212779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060212779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060212779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060212782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060212782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060212782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:14.185265 run osmo-stp_10.42.42.5(pid=32313): stdout: | (launched: 2022-12-09_06:02:12.613908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:14.305962 run osmo-stp_10.42.42.5(pid=32313): stderr: | 20221209060212779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060212779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060212779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060212779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060212782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060212782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060212782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:14.448893 run patchelf(pid=32316): Terminating (SIGINT) 06:02:14.614592 run patchelf(pid=32316): Terminated: ok {rc=0} 06:02:14.734119 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32313): Process ended prematurely: osmo-stp_10.42.42.5(pid=32313) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32313)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 06:02:14.742759 tst ping.py:22: Test FAILED (6.3 sec) 06:02:14.769550 run osmo-hlr_10.42.42.2(pid=32310): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32310)] 06:02:14.817913 run osmo-hlr_10.42.42.2(pid=32310): stdout: | (launched: 2022-12-09_06:02:11.706010) 06:02:14.867854 run osmo-hlr_10.42.42.2(pid=32310): stderr: | 20221209060211880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060211880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060211881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060211881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060211881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060211881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060211894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060211902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060211902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060211902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:14.917701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32309): Terminating (SIGTERM) 06:02:14.957759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32312): Terminating (SIGTERM) 06:02:14.997957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32315): Terminating (SIGTERM) 06:02:15.038364 --- ParallelTerminationStrategy: PID 32309 died... 06:02:15.057394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32309): Terminated: ok {rc=0} 06:02:15.101894 --- ParallelTerminationStrategy: PID 32312 died... 06:02:15.120483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32312): Terminated: ok {rc=0} 06:02:15.165195 --- ParallelTerminationStrategy: PID 32315 died... 06:02:15.183921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32315): Terminated: ok {rc=0} 06:02:15.268473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:02:16.352732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:16.365466 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:02:16.439342 tst ping_idle_ping.py: using LAC 19428 06:02:16.592447 tst ping_idle_ping.py: using RAC 48 06:02:16.746802 tst ping_idle_ping.py: using CellId 19428 06:02:16.900644 tst ping_idle_ping.py: using BVCI 19429 06:02:17.054835 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.067949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.083399 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.098630 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.113321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.129415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.145420 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:02:17.160618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:02:17.298538 tst ping_idle_ping.py:24: start network... 06:02:17.513899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:18.012728 run create_hlr_db(pid=32317): Launched 06:02:18.141154 bus /gobi_6: Setting Powered False 06:02:19.204438 run create_hlr_db(pid=32317): Terminated: ok {rc=0} 06:02:19.629633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Launched 06:02:19.925550 run osmo-hlr_10.42.42.2(pid=32320): Launched 06:02:20.037947 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:20.546335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Launched 06:02:20.840118 run osmo-stp_10.42.42.5(pid=32323): Launched 06:02:20.952208 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:21.462389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Launched 06:02:21.575058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:21.823587 run patchelf(pid=32326): Launched 06:02:21.988296 run osmo-stp_10.42.42.5(pid=32323): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] 06:02:22.114055 run osmo-stp_10.42.42.5(pid=32323): stdout: | (launched: 2022-12-09_06:02:20.786591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:22.240472 run osmo-stp_10.42.42.5(pid=32323): stderr: | 20221209060220956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060220956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060220957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060220957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060220958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060220958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060220958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:22.367280 run osmo-stp_10.42.42.5(pid=32323): stdout: | (launched: 2022-12-09_06:02:20.786591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:22.488261 run osmo-stp_10.42.42.5(pid=32323): stderr: | 20221209060220956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060220956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060220957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060220957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060220958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060220958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060220958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:22.631513 run patchelf(pid=32326): Terminating (SIGINT) 06:02:22.797694 run patchelf(pid=32326): Terminated: ok {rc=0} 06:02:22.917746 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32323): Process ended prematurely: osmo-stp_10.42.42.5(pid=32323) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:02:22.926479 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:02:22.953406 run osmo-hlr_10.42.42.2(pid=32320): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32320)] 06:02:23.001364 run osmo-hlr_10.42.42.2(pid=32320): stdout: | (launched: 2022-12-09_06:02:19.871584) 06:02:23.050923 run osmo-hlr_10.42.42.2(pid=32320): stderr: | 20221209060220045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060220045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060220045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060220045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060220045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060220045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060220058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060220067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060220067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060220067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:23.100915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Terminating (SIGTERM) 06:02:23.141203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Terminating (SIGTERM) 06:02:23.181694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Terminating (SIGTERM) 06:02:23.221959 --- ParallelTerminationStrategy: PID 32319 died... 06:02:23.241073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32319): Terminated: ok {rc=0} 06:02:23.285647 --- ParallelTerminationStrategy: PID 32322 died... 06:02:23.304053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32322): Terminated: ok {rc=0} 06:02:23.348311 --- ParallelTerminationStrategy: PID 32325 died... 06:02:23.366780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32325): Terminated: ok {rc=0} 06:02:23.452888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:02:24.756239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:02:24.762333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:02:24.795870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:02:24.833988 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:02:24.919647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:02:24.952384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:02:24.990440 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:02:25.588512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:02:25.641920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:25.653543 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:25.725053 tst cs_paging_gprs_active.py: using LAC 19429 06:02:25.849740 tst cs_paging_gprs_active.py: using RAC 49 06:02:25.974592 tst cs_paging_gprs_active.py: using CellId 19429 06:02:26.099494 tst cs_paging_gprs_active.py: using BVCI 19430 06:02:26.216189 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.227494 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.238695 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.250008 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.261243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.272360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.283650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.294898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:26.306298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:26.421743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:26.543814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:02:26.761871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:27.085406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32332): Launched 06:02:27.365427 run iperf3-srv_10.42.42.10(pid=32333): Launched 06:02:27.486919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:02:27.705033 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:28.028659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Launched 06:02:28.307902 run iperf3-srv_10.42.42.10(pid=32335): Launched 06:02:28.429157 tst cs_paging_gprs_active.py:38: start network... 06:02:28.645872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:29.145012 run create_hlr_db(pid=32336): Launched 06:02:29.275688 bus /gobi_6: Setting Powered False 06:02:30.338927 run create_hlr_db(pid=32336): Terminated: ok {rc=0} 06:02:30.785949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32338): Launched 06:02:31.141678 run osmo-hlr_10.42.42.2(pid=32339): Launched 06:02:31.366136 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:31.989788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32341): Launched 06:02:32.333673 run osmo-stp_10.42.42.5(pid=32342): Launched 06:02:32.467850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:33.001643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32344): Launched 06:02:33.116603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:33.368776 run patchelf(pid=32345): Launched 06:02:33.535801 run osmo-stp_10.42.42.5(pid=32342): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32342)] 06:02:33.663095 run osmo-stp_10.42.42.5(pid=32342): stdout: | (launched: 2022-12-09_06:02:32.260924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:33.792379 run osmo-stp_10.42.42.5(pid=32342): stderr: | 20221209060232467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060232467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060232467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060232467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060232468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060232468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060232468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:33.921401 run osmo-stp_10.42.42.5(pid=32342): stdout: | (launched: 2022-12-09_06:02:32.260924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:34.044530 run osmo-stp_10.42.42.5(pid=32342): stderr: | 20221209060232467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060232467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060232467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060232467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060232468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060232468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060232468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:34.190575 run patchelf(pid=32345): Terminating (SIGINT) 06:02:34.359358 run patchelf(pid=32345): Terminated: ok {rc=0} 06:02:34.481128 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32342): Process ended prematurely: osmo-stp_10.42.42.5(pid=32342) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32342)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:02:34.490439 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:02:34.517895 run osmo-hlr_10.42.42.2(pid=32339): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32339)] 06:02:34.565814 run osmo-hlr_10.42.42.2(pid=32339): stdout: | (launched: 2022-12-09_06:02:31.068397) 06:02:34.615549 run osmo-hlr_10.42.42.2(pid=32339): stderr: | 20221209060231321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060231321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060231321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060231321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060231321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060231321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060231337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060231362 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060231362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060231362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:34.665757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32332): Terminating (SIGTERM) 06:02:34.706049 run iperf3-srv_10.42.42.10(pid=32333): Terminating (SIGTERM) 06:02:34.746059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Terminating (SIGTERM) 06:02:34.786087 run iperf3-srv_10.42.42.10(pid=32335): Terminating (SIGTERM) 06:02:34.825933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32338): Terminating (SIGTERM) 06:02:34.865909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32341): Terminating (SIGTERM) 06:02:34.905924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32344): Terminating (SIGTERM) 06:02:34.946156 --- ParallelTerminationStrategy: PID 32332 died... 06:02:34.965119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32332): Terminated: ok {rc=0} 06:02:35.009524 --- ParallelTerminationStrategy: PID 32333 died... 06:02:35.027984 run iperf3-srv_10.42.42.10(pid=32333): Terminated {rc=256} 06:02:35.072314 --- ParallelTerminationStrategy: PID 32334 died... 06:02:35.090883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Terminated: ok {rc=0} 06:02:35.135007 --- ParallelTerminationStrategy: PID 32335 died... 06:02:35.153444 run iperf3-srv_10.42.42.10(pid=32335): Terminated {rc=256} 06:02:35.197574 --- ParallelTerminationStrategy: PID 32338 died... 06:02:35.216013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32338): Terminated: ok {rc=0} 06:02:35.260028 --- ParallelTerminationStrategy: PID 32341 died... 06:02:35.278517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32341): Terminated: ok {rc=0} 06:02:35.322501 --- ParallelTerminationStrategy: PID 32344 died... 06:02:35.341358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32344): Terminated: ok {rc=0} 06:02:35.427100 bus /gobi_0: Setting Powered False 06:02:36.526192 bus /gobi_0: Setting Powered False 06:02:37.640801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:02:38.786010 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:38.797541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:38.871515 tst iperf3.py: using LAC 19430 06:02:38.990231 tst iperf3.py: using RAC 50 06:02:39.111620 tst iperf3.py: using CellId 19430 06:02:39.229072 tst iperf3.py: using BVCI 19431 06:02:39.338132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.349070 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.359821 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.371433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.383051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.394479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.406166 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.417751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:39.429407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:39.547495 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:39.765012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:40.088817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32346): Launched 06:02:40.367718 run iperf3-srv_10.42.42.10(pid=32347): Launched 06:02:40.488285 tst iperf3.py:8: start network... 06:02:40.704338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:41.202076 run create_hlr_db(pid=32348): Launched 06:02:41.332231 bus /gobi_6: Setting Powered False 06:02:42.396108 run create_hlr_db(pid=32348): Terminated: ok {rc=0} 06:02:42.841827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32350): Launched 06:02:43.162080 run osmo-hlr_10.42.42.2(pid=32351): Launched 06:02:43.284089 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:43.843364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32353): Launched 06:02:44.164646 run osmo-stp_10.42.42.5(pid=32354): Launched 06:02:44.286782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:44.841413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32356): Launched 06:02:44.963704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:45.235770 run patchelf(pid=32357): Launched 06:02:45.414762 run osmo-stp_10.42.42.5(pid=32354): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32354)] 06:02:45.551145 run osmo-stp_10.42.42.5(pid=32354): stdout: | (launched: 2022-12-09_06:02:44.106653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:45.689183 run osmo-stp_10.42.42.5(pid=32354): stderr: | 20221209060244300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060244301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060244301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060244301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060244302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060244302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060244302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:45.827291 run osmo-stp_10.42.42.5(pid=32354): stdout: | (launched: 2022-12-09_06:02:44.106653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:45.984594 run osmo-stp_10.42.42.5(pid=32354): stderr: | 20221209060244300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060244301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060244301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060244301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060244302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060244302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060244302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:46.137803 run patchelf(pid=32357): Terminating (SIGINT) 06:02:46.313526 run patchelf(pid=32357): Terminated: ok {rc=0} 06:02:46.440104 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32354): Process ended prematurely: osmo-stp_10.42.42.5(pid=32354) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32354)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 06:02:46.450715 tst iperf3.py:8: Test FAILED (7.7 sec) 06:02:46.483035 run osmo-hlr_10.42.42.2(pid=32351): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32351)] 06:02:46.534669 run osmo-hlr_10.42.42.2(pid=32351): stdout: | (launched: 2022-12-09_06:02:43.104127) 06:02:46.588493 run osmo-hlr_10.42.42.2(pid=32351): stderr: | 20221209060243304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060243304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060243304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060243304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060243304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060243304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060243317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060243325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060243325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060243325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:46.642090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32346): Terminating (SIGTERM) 06:02:46.687910 run iperf3-srv_10.42.42.10(pid=32347): Terminating (SIGTERM) 06:02:46.734187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32350): Terminating (SIGTERM) 06:02:46.779184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32353): Terminating (SIGTERM) 06:02:46.824576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32356): Terminating (SIGTERM) 06:02:46.870564 --- ParallelTerminationStrategy: PID 32346 died... 06:02:46.890823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32346): Terminated: ok {rc=0} 06:02:46.941088 --- ParallelTerminationStrategy: PID 32347 died... 06:02:46.963610 run iperf3-srv_10.42.42.10(pid=32347): Terminated {rc=256} 06:02:47.011761 --- ParallelTerminationStrategy: PID 32350 died... 06:02:47.031617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32350): Terminated: ok {rc=0} 06:02:47.080658 --- ParallelTerminationStrategy: PID 32353 died... 06:02:47.100532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32353): Terminated: ok {rc=0} 06:02:47.149168 --- ParallelTerminationStrategy: PID 32356 died... 06:02:47.168209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32356): Terminated: ok {rc=0} 06:02:47.255957 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:02:48.403955 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:48.415615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:02:48.486405 tst iperf3m4.py: using LAC 19431 06:02:48.604332 tst iperf3m4.py: using RAC 51 06:02:48.732826 tst iperf3m4.py: using CellId 19431 06:02:48.860582 tst iperf3m4.py: using BVCI 19432 06:02:48.970545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:48.981741 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:48.992492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.003840 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.014996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.026110 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.037155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.047981 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:02:49.059157 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:49.175225 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:49.296062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:49.410761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:02:49.530310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:02:49.747692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:50.070878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32358): Launched 06:02:50.350299 run iperf3-srv_10.42.42.10(pid=32359): Launched 06:02:50.470714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:02:50.686835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:51.008436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32360): Launched 06:02:51.287997 run iperf3-srv_10.42.42.10(pid=32361): Launched 06:02:51.408328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:02:51.624561 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:51.947005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32362): Launched 06:02:52.227335 run iperf3-srv_10.42.42.10(pid=32363): Launched 06:02:52.347571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:02:52.563261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:02:52.884564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Launched 06:02:53.162461 run iperf3-srv_10.42.42.10(pid=32365): Launched 06:02:53.282423 tst iperf3m4.py:8: start network... 06:02:53.498009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:02:53.994954 run create_hlr_db(pid=32366): Launched 06:02:54.125207 bus /gobi_6: Setting Powered False 06:02:55.189063 run create_hlr_db(pid=32366): Terminated: ok {rc=0} 06:02:55.616534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Launched 06:02:55.916560 run osmo-hlr_10.42.42.2(pid=32369): Launched 06:02:56.030999 run osmo-stp_10.42.42.5: Starting osmo-stp 06:02:56.559217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Launched 06:02:56.857435 run osmo-stp_10.42.42.5(pid=32372): Launched 06:02:56.970986 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:02:57.486234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32374): Launched 06:02:57.600638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:02:57.853323 run patchelf(pid=32375): Launched 06:02:58.020678 run osmo-stp_10.42.42.5(pid=32372): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] 06:02:58.148733 run osmo-stp_10.42.42.5(pid=32372): stdout: | (launched: 2022-12-09_06:02:56.803101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:58.277963 run osmo-stp_10.42.42.5(pid=32372): stderr: | 20221209060256970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060256970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060256971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060256971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060256972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060256972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060256972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:58.407050 run osmo-stp_10.42.42.5(pid=32372): stdout: | (launched: 2022-12-09_06:02:56.803101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:02:58.531569 run osmo-stp_10.42.42.5(pid=32372): stderr: | 20221209060256970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060256970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060256971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060256971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060256972 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060256972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060256972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:02:58.678357 run patchelf(pid=32375): Terminating (SIGINT) 06:02:58.847439 run patchelf(pid=32375): Terminated: ok {rc=0} 06:02:58.968856 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32372): Process ended prematurely: osmo-stp_10.42.42.5(pid=32372) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:02:58.978375 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:02:59.006249 run osmo-hlr_10.42.42.2(pid=32369): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32369)] 06:02:59.054780 run osmo-hlr_10.42.42.2(pid=32369): stdout: | (launched: 2022-12-09_06:02:55.861935) 06:02:59.104753 run osmo-hlr_10.42.42.2(pid=32369): stderr: | 20221209060256035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060256035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060256035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060256035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060256035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060256036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060256048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060256057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060256057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060256057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:02:59.155374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32358): Terminating (SIGTERM) 06:02:59.196302 run iperf3-srv_10.42.42.10(pid=32359): Terminating (SIGTERM) 06:02:59.236999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32360): Terminating (SIGTERM) 06:02:59.278064 run iperf3-srv_10.42.42.10(pid=32361): Terminating (SIGTERM) 06:02:59.318637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32362): Terminating (SIGTERM) 06:02:59.359275 run iperf3-srv_10.42.42.10(pid=32363): Terminating (SIGTERM) 06:02:59.400020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Terminating (SIGTERM) 06:02:59.440714 run iperf3-srv_10.42.42.10(pid=32365): Terminating (SIGTERM) 06:02:59.481086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Terminating (SIGTERM) 06:02:59.521935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Terminating (SIGTERM) 06:02:59.562432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32374): Terminating (SIGTERM) 06:02:59.603038 --- ParallelTerminationStrategy: PID 32358 died... 06:02:59.622265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32358): Terminated: ok {rc=0} 06:02:59.667787 --- ParallelTerminationStrategy: PID 32359 died... 06:02:59.686656 run iperf3-srv_10.42.42.10(pid=32359): Terminated {rc=256} 06:02:59.731353 --- ParallelTerminationStrategy: PID 32360 died... 06:02:59.750193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32360): Terminated: ok {rc=0} 06:02:59.795037 --- ParallelTerminationStrategy: PID 32361 died... 06:02:59.813890 run iperf3-srv_10.42.42.10(pid=32361): Terminated {rc=256} 06:02:59.858703 --- ParallelTerminationStrategy: PID 32362 died... 06:02:59.877545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32362): Terminated: ok {rc=0} 06:02:59.923022 --- ParallelTerminationStrategy: PID 32363 died... 06:02:59.942041 run iperf3-srv_10.42.42.10(pid=32363): Terminated {rc=256} 06:02:59.987403 --- ParallelTerminationStrategy: PID 32364 died... 06:03:00.006228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32364): Terminated: ok {rc=0} 06:03:00.051217 --- ParallelTerminationStrategy: PID 32365 died... 06:03:00.070070 run iperf3-srv_10.42.42.10(pid=32365): Terminated {rc=256} 06:03:00.114821 --- ParallelTerminationStrategy: PID 32368 died... 06:03:00.133794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32368): Terminated: ok {rc=0} 06:03:00.178497 --- ParallelTerminationStrategy: PID 32371 died... 06:03:00.197346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32371): Terminated: ok {rc=0} 06:03:00.242463 --- ParallelTerminationStrategy: PID 32374 died... 06:03:00.261450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32374): Terminated: ok {rc=0} 06:03:00.350365 bus /gobi_4: Setting Powered False 06:03:01.454805 bus /gobi_4: Setting Powered False 06:03:02.567844 bus /gobi_1: Setting Powered False 06:03:03.666589 bus /gobi_1: Setting Powered False 06:03:04.781730 bus /gobi_0: Setting Powered False 06:03:05.880366 bus /gobi_0: Setting Powered False 06:03:06.999072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:03:08.103423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.115076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:08.186925 tst ping.py: using LAC 19432 06:03:08.303405 tst ping.py: using RAC 52 06:03:08.417791 tst ping.py: using CellId 19432 06:03:08.534694 tst ping.py: using BVCI 19433 06:03:08.642632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.653684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.664481 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.675503 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.686425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.697908 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.709030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:08.719992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:08.833371 tst ping.py:19: start network... 06:03:09.028636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:09.480381 run create_hlr_db(pid=32378): Launched 06:03:09.591153 bus /gobi_6: Setting Powered False 06:03:10.650354 run create_hlr_db(pid=32378): Terminated: ok {rc=0} 06:03:11.061477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Launched 06:03:11.353663 run osmo-hlr_10.42.42.2(pid=32381): Launched 06:03:11.465376 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:11.987022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Launched 06:03:12.280271 run osmo-stp_10.42.42.5(pid=32384): Launched 06:03:12.391618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:12.898091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Launched 06:03:13.010784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:13.259223 run patchelf(pid=32387): Launched 06:03:13.422303 run osmo-stp_10.42.42.5(pid=32384): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] 06:03:13.547201 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-09_06:03:12.226444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:13.674066 run osmo-stp_10.42.42.5(pid=32384): stderr: | 20221209060312396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060312396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060312396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060312397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060312397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060312397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060312398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:13.800656 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-09_06:03:12.226444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:13.920781 run osmo-stp_10.42.42.5(pid=32384): stderr: | 20221209060312396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060312396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060312396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060312397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060312397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060312397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060312398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:14.064076 run patchelf(pid=32387): Terminating (SIGINT) 06:03:14.229171 run patchelf(pid=32387): Terminated: ok {rc=0} 06:03:14.348346 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 06:03:14.357144 tst ping.py:22: Test FAILED (6.2 sec) 06:03:14.383868 run osmo-hlr_10.42.42.2(pid=32381): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32381)] 06:03:14.431946 run osmo-hlr_10.42.42.2(pid=32381): stdout: | (launched: 2022-12-09_06:03:11.300528) 06:03:14.481521 run osmo-hlr_10.42.42.2(pid=32381): stderr: | 20221209060311472 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060311472 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060311472 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060311472 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060311472 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060311472 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060311484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060311493 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060311493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060311493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:14.531508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminating (SIGTERM) 06:03:14.571734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminating (SIGTERM) 06:03:14.611848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminating (SIGTERM) 06:03:14.652027 --- ParallelTerminationStrategy: PID 32380 died... 06:03:14.671105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminated: ok {rc=0} 06:03:14.715581 --- ParallelTerminationStrategy: PID 32383 died... 06:03:14.734192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminated: ok {rc=0} 06:03:14.778302 --- ParallelTerminationStrategy: PID 32386 died... 06:03:14.796749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminated: ok {rc=0} 06:03:14.881447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:03:15.973585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:15.987677 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:03:16.071760 tst ping_idle_ping.py: using LAC 19433 06:03:16.195821 tst ping_idle_ping.py: using RAC 53 06:03:16.359915 tst ping_idle_ping.py: using CellId 19433 06:03:16.513950 tst ping_idle_ping.py: using BVCI 19434 06:03:16.658675 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.671376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.683699 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.696858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.709079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.721469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.733500 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:03:16.745328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:03:16.884712 tst ping_idle_ping.py:24: start network... 06:03:17.089178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:17.554111 run create_hlr_db(pid=32390): Launched 06:03:17.666981 bus /gobi_6: Setting Powered False 06:03:18.726351 run create_hlr_db(pid=32390): Terminated: ok {rc=0} 06:03:19.137657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32392): Launched 06:03:19.430274 run osmo-hlr_10.42.42.2(pid=32393): Launched 06:03:19.541846 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:20.062229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32395): Launched 06:03:20.380814 run osmo-stp_10.42.42.5(pid=32396): Launched 06:03:20.501297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:21.049447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32398): Launched 06:03:21.170562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:21.437336 run patchelf(pid=32399): Launched 06:03:21.614246 run osmo-stp_10.42.42.5(pid=32396): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32396)] 06:03:21.749403 run osmo-stp_10.42.42.5(pid=32396): stdout: | (launched: 2022-12-09_06:03:20.323520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:21.886710 run osmo-stp_10.42.42.5(pid=32396): stderr: | 20221209060320516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060320516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060320516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060320517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060320517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060320517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060320517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:22.023577 run osmo-stp_10.42.42.5(pid=32396): stdout: | (launched: 2022-12-09_06:03:20.323520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:22.155215 run osmo-stp_10.42.42.5(pid=32396): stderr: | 20221209060320516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060320516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060320516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060320517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060320517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060320517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060320517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:22.309831 run patchelf(pid=32399): Terminating (SIGINT) 06:03:22.488429 run patchelf(pid=32399): Terminated: ok {rc=0} 06:03:22.617186 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32396): Process ended prematurely: osmo-stp_10.42.42.5(pid=32396) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32396)] [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:03:22.626687 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:03:22.654407 run osmo-hlr_10.42.42.2(pid=32393): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32393)] 06:03:22.704127 run osmo-hlr_10.42.42.2(pid=32393): stdout: | (launched: 2022-12-09_06:03:19.377105) 06:03:22.755651 run osmo-hlr_10.42.42.2(pid=32393): stderr: | 20221209060319551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060319551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060319551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060319551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060319551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060319551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060319564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060319572 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060319572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060319572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:22.807900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32392): Terminating (SIGTERM) 06:03:22.849711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32395): Terminating (SIGTERM) 06:03:22.891507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32398): Terminating (SIGTERM) 06:03:22.933403 --- ParallelTerminationStrategy: PID 32392 died... 06:03:22.953256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32392): Terminated: ok {rc=0} 06:03:22.999290 --- ParallelTerminationStrategy: PID 32395 died... 06:03:23.018873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32395): Terminated: ok {rc=0} 06:03:23.065210 --- ParallelTerminationStrategy: PID 32398 died... 06:03:23.084701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32398): Terminated: ok {rc=0} 06:03:23.173114 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:03:24.477579 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:24.484239 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:03:24.517888 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:03:24.551901 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:03:24.604459 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:03:24.637685 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:03:24.671569 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:03:25.230372 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:03:25.235333 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.246564 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:03:25.315132 tst switch_tch_pdch.py: using LAC 19434 06:03:25.430110 tst switch_tch_pdch.py: using RAC 54 06:03:25.544424 tst switch_tch_pdch.py: using CellId 19434 06:03:25.659260 tst switch_tch_pdch.py: using BVCI 19435 06:03:25.765327 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.776490 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.787509 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.798820 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.810269 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.821470 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.832800 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:03:25.844091 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:03:25.962686 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:03:26.081495 tst switch_tch_pdch.py:51: start network... 06:03:26.294967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:26.782963 run create_hlr_db(pid=32403): Launched 06:03:26.910748 bus /gobi_6: Setting Powered False 06:03:27.973294 run create_hlr_db(pid=32403): Terminated: ok {rc=0} 06:03:28.397865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Launched 06:03:28.692473 run osmo-hlr_10.42.42.2(pid=32406): Launched 06:03:28.804374 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:29.310317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Launched 06:03:29.601525 run osmo-stp_10.42.42.5(pid=32409): Launched 06:03:29.712207 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:30.219625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32411): Launched 06:03:30.332503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:30.579350 run patchelf(pid=32412): Launched 06:03:30.742275 run osmo-stp_10.42.42.5(pid=32409): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] 06:03:30.874701 run osmo-stp_10.42.42.5(pid=32409): stdout: | (launched: 2022-12-09_06:03:29.548544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:31.007926 run osmo-stp_10.42.42.5(pid=32409): stderr: | 20221209060329717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060329717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060329717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060329718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060329720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060329720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060329720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:31.137416 run osmo-stp_10.42.42.5(pid=32409): stdout: | (launched: 2022-12-09_06:03:29.548544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:31.261213 run osmo-stp_10.42.42.5(pid=32409): stderr: | 20221209060329717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060329717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060329717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060329718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060329720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060329720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060329720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:31.407074 run patchelf(pid=32412): Terminating (SIGINT) 06:03:31.575873 run patchelf(pid=32412): Terminated: ok {rc=0} 06:03:31.698224 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32409): Process ended prematurely: osmo-stp_10.42.42.5(pid=32409) [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:03:31.707988 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 06:03:31.737773 run osmo-hlr_10.42.42.2(pid=32406): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32406)] 06:03:31.788045 run osmo-hlr_10.42.42.2(pid=32406): stdout: | (launched: 2022-12-09_06:03:28.638837) 06:03:31.840024 run osmo-hlr_10.42.42.2(pid=32406): stderr: | 20221209060328815 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060328815 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060328815 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060328815 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060328815 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060328815 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060328826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060328835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060328835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060328835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:31.892723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Terminating (SIGTERM) 06:03:31.935471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Terminating (SIGTERM) 06:03:31.979645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32411): Terminating (SIGTERM) 06:03:32.023848 --- ParallelTerminationStrategy: PID 32405 died... 06:03:32.043450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32405): Terminated: ok {rc=0} 06:03:32.091084 --- ParallelTerminationStrategy: PID 32408 died... 06:03:32.110651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32408): Terminated: ok {rc=0} 06:03:32.157313 --- ParallelTerminationStrategy: PID 32411 died... 06:03:32.176852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32411): Terminated: ok {rc=0} 06:03:32.262824 bus /gobi_0: Setting Powered False 06:03:33.363552 bus /gobi_0: Setting Powered False 06:03:34.478748 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:03:35.733374 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:35.739287 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:03:35.772900 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:03:35.807235 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:03:35.859321 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:03:35.892548 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:03:35.926404 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:03:36.482879 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:03:36.487855 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:36.498752 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:03:36.567740 tst switch_tch_pdch.py: using LAC 19435 06:03:36.682226 tst switch_tch_pdch.py: using RAC 55 06:03:36.797190 tst switch_tch_pdch.py: using CellId 19435 06:03:36.921892 tst switch_tch_pdch.py: using BVCI 19436 06:03:37.037334 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.049150 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.060487 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.071774 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.083052 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.094491 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.105904 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:03:37.117178 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:03:37.233285 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:03:37.347018 tst switch_tch_pdch.py:51: start network... 06:03:37.544754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:37.978314 run create_hlr_db(pid=32416): Launched 06:03:38.091332 bus /gobi_6: Setting Powered False 06:03:39.151843 run create_hlr_db(pid=32416): Terminated: ok {rc=0} 06:03:39.558375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Launched 06:03:39.873637 run osmo-hlr_10.42.42.2(pid=32419): Launched 06:03:39.994026 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:40.513684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Launched 06:03:40.827618 run osmo-stp_10.42.42.5(pid=32422): Launched 06:03:40.946474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:03:41.462530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Launched 06:03:41.575633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:03:41.823194 run patchelf(pid=32425): Launched 06:03:41.987808 run osmo-stp_10.42.42.5(pid=32422): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] 06:03:42.113411 run osmo-stp_10.42.42.5(pid=32422): stdout: | (launched: 2022-12-09_06:03:40.770877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:42.240196 run osmo-stp_10.42.42.5(pid=32422): stderr: | 20221209060340963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060340963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060340964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060340964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060340964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060340964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060340965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:42.367467 run osmo-stp_10.42.42.5(pid=32422): stdout: | (launched: 2022-12-09_06:03:40.770877) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:03:42.487977 run osmo-stp_10.42.42.5(pid=32422): stderr: | 20221209060340963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060340963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060340964 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060340964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060340964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060340964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060340965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:03:42.630864 run patchelf(pid=32425): Terminating (SIGINT) 06:03:42.797413 run patchelf(pid=32425): Terminated: ok {rc=0} 06:03:42.916565 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32422): Process ended prematurely: osmo-stp_10.42.42.5(pid=32422) [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:03:42.925374 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 06:03:42.951983 run osmo-hlr_10.42.42.2(pid=32419): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32419)] 06:03:42.999940 run osmo-hlr_10.42.42.2(pid=32419): stdout: | (launched: 2022-12-09_06:03:39.816855) 06:03:43.049334 run osmo-hlr_10.42.42.2(pid=32419): stderr: | 20221209060340012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060340012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060340013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060340013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060340013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060340013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060340025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060340033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060340033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060340034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:03:43.099878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Terminating (SIGTERM) 06:03:43.140141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Terminating (SIGTERM) 06:03:43.180356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Terminating (SIGTERM) 06:03:43.220508 --- ParallelTerminationStrategy: PID 32418 died... 06:03:43.240047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32418): Terminated: ok {rc=0} 06:03:43.285115 --- ParallelTerminationStrategy: PID 32421 died... 06:03:43.303879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32421): Terminated: ok {rc=0} 06:03:43.349002 --- ParallelTerminationStrategy: PID 32424 died... 06:03:43.367767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32424): Terminated: ok {rc=0} 06:03:43.452301 bus /gobi_0: Setting Powered False 06:03:44.550309 bus /gobi_0: Setting Powered False 06:03:45.665716 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:trx-umtrx --------------------------------------------------------------------- 06:03:46.946939 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:46.950741 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:46.989511 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:03:46.997032 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:03:47.048224 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:47.083341 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:03:47.091845 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:03:47.628466 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:03:47.633616 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:03:47.644438 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:47.691555 tst mo_mt_sms.py: using LAC 19436 06:03:47.807245 tst mo_mt_sms.py: using RAC 56 06:03:47.920940 tst mo_mt_sms.py: using CellId 19436 06:03:48.046963 tst mo_mt_sms.py: using BVCI 19437 06:03:48.155021 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:48.273057 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:48.391189 tst mo_mt_sms.py:9: start nitb and bts... 06:03:48.605897 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:03:49.247409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32429): Launched 06:03:49.562015 run osmo-nitb_10.42.42.2(pid=32430): Launched 06:03:49.735885 run osmo-nitb_10.42.42.2(pid=32430): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32430)] 06:03:49.877469 run osmo-nitb_10.42.42.2(pid=32430): stdout: | (launched: 2022-12-09_06:03:49.505134) 06:03:50.020398 run osmo-nitb_10.42.42.2(pid=32430): stderr: | (launched: 2022-12-09_06:03:49.551887) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:50.164009 run osmo-nitb_10.42.42.2(pid=32430): stdout: | (launched: 2022-12-09_06:03:49.505134) 06:03:50.300677 run osmo-nitb_10.42.42.2(pid=32430): stderr: | (launched: 2022-12-09_06:03:49.551887) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32430) [trial-2355↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32430)] 06:03:50.679669 tst osmo-nitb_10.42.42.2(pid=32430): stdout: | (launched: 2022-12-09_06:03:49.505134) 06:03:50.806602 tst osmo-nitb_10.42.42.2(pid=32430): stderr: | (launched: 2022-12-09_06:03:49.551887) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:03:50.956854 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32430) [trial-2355↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32430)] [trial-2355↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 06:03:50.965823 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 06:03:50.972716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32429): Terminating (SIGTERM) 06:03:51.184449 --- ParallelTerminationStrategy: PID 32429 died... 06:03:51.205813 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32429): Terminated: ok {rc=0} 06:03:51.295440 bus /sierra_3: Setting Powered False 06:03:52.397089 bus /sierra_3: Setting Powered False 06:03:53.518643 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:trx-umtrx --------------------------------------------------------------------- 06:03:54.715723 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:03:54.719557 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:03:54.752215 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:03:54.779235 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 06:03:54.831523 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:03:54.866458 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:03:54.893687 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 06:03:55.434887 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 06:03:55.440806 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:55.451840 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 06:03:55.499446 tst mo_mt_sms.py: using LAC 19437 06:03:55.614934 tst mo_mt_sms.py: using RAC 57 06:03:55.735716 tst mo_mt_sms.py: using CellId 19437 06:03:55.851432 tst mo_mt_sms.py: using BVCI 19438 06:03:55.956752 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:55.967362 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:55.977717 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:55.988264 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:55.998872 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:03:56.009472 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:56.128034 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 06:03:56.242634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:03:56.698111 run create_hlr_db(pid=32434): Launched 06:03:56.809112 bus /sierra_2: Setting Powered False 06:03:57.867582 run create_hlr_db(pid=32434): Terminated: ok {rc=0} 06:03:58.277123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32436): Launched 06:03:58.568738 run osmo-hlr_10.42.42.2(pid=32437): Launched 06:03:58.680710 run osmo-stp_10.42.42.5: Starting osmo-stp 06:03:59.186459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32439): Launched 06:03:59.479135 run osmo-stp_10.42.42.5(pid=32440): Launched 06:03:59.590898 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:00.123313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32442): Launched 06:04:00.416808 run osmo-msc_10.42.42.6(pid=32443): Launched 06:04:00.580923 run osmo-stp_10.42.42.5(pid=32440): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32440)] 06:04:00.705862 run osmo-stp_10.42.42.5(pid=32440): stdout: | (launched: 2022-12-09_06:03:59.425462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:00.836068 run osmo-stp_10.42.42.5(pid=32440): stderr: | 20221209060359595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060359595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060359595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060359596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060359598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060359598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060359598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:00.982852 run osmo-stp_10.42.42.5(pid=32440): stdout: | (launched: 2022-12-09_06:03:59.425462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:01.103692 run osmo-stp_10.42.42.5(pid=32440): stderr: | 20221209060359595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060359595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060359595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060359596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060359598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060359598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060359598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:01.259786 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32440): Process ended prematurely: osmo-stp_10.42.42.5(pid=32440) [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32440)] [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py:16] 06:04:01.273445 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 06:04:01.312056 run osmo-hlr_10.42.42.2(pid=32437): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32437)] 06:04:01.379398 run osmo-hlr_10.42.42.2(pid=32437): stdout: | (launched: 2022-12-09_06:03:58.515871) 06:04:01.447989 run osmo-hlr_10.42.42.2(pid=32437): stderr: | 20221209060358689 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060358689 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060358689 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060358689 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060358689 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060358689 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060358701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060358709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060358709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060358709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:01.521356 run osmo-msc_10.42.42.6(pid=32443): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32443)] 06:04:01.572446 run osmo-msc_10.42.42.6(pid=32443): stdout: | (launched: 2022-12-09_06:04:00.362772) 06:04:01.625324 run osmo-msc_10.42.42.6(pid=32443): stderr: | 20221209060400634 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060400634 DLGLOBAL DEBUG validating counter group 0x7f52a0db6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060400634 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060400634 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060400634 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060400634 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060400636 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060400636 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060400637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060400637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:01.678594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32436): Terminating (SIGTERM) 06:04:01.721567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32439): Terminating (SIGTERM) 06:04:01.764008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32442): Terminating (SIGTERM) 06:04:01.807040 --- ParallelTerminationStrategy: PID 32436 died... 06:04:01.826935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32436): Terminated: ok {rc=0} 06:04:01.874666 --- ParallelTerminationStrategy: PID 32439 died... 06:04:01.894451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32439): Terminated: ok {rc=0} 06:04:01.942175 --- ParallelTerminationStrategy: PID 32442 died... 06:04:01.961987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32442): Terminated: ok {rc=0} 06:04:02.049858 bus /sierra_3: Setting Powered False 06:04:03.149056 bus /sierra_3: Setting Powered False 06:04:04.265451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 06:04:05.494931 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:05.498691 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:05.531490 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 06:04:05.538247 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:04:05.573183 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:05.606015 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 06:04:05.612803 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:04:06.130776 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:04:06.135935 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 06:04:06.146697 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:06.194770 tst assert_extension.py: using LAC 19438 06:04:06.310023 tst assert_extension.py: using RAC 58 06:04:06.425975 tst assert_extension.py: using CellId 19438 06:04:06.544038 tst assert_extension.py: using BVCI 19439 06:04:06.649994 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:04:06.767900 tst assert_extension.py:10: start nitb and bts... 06:04:06.979610 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:04:07.623612 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32448): Launched 06:04:07.937765 run osmo-nitb_10.42.42.2(pid=32449): Launched 06:04:08.111664 run osmo-nitb_10.42.42.2(pid=32449): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32449)] 06:04:08.252480 run osmo-nitb_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-09_06:04:07.881221) 06:04:08.395845 run osmo-nitb_10.42.42.2(pid=32449): stderr: | (launched: 2022-12-09_06:04:07.927888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:08.539699 run osmo-nitb_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-09_06:04:07.881221) 06:04:08.676905 run osmo-nitb_10.42.42.2(pid=32449): stderr: | (launched: 2022-12-09_06:04:07.927888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32449): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32449) [trial-2355↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32449)] 06:04:09.055816 tst osmo-nitb_10.42.42.2(pid=32449): stdout: | (launched: 2022-12-09_06:04:07.881221) 06:04:09.183059 tst osmo-nitb_10.42.42.2(pid=32449): stderr: | (launched: 2022-12-09_06:04:07.927888) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:04:09.332781 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32449): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32449) [trial-2355↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32449)] [trial-2355↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 06:04:09.341707 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:04:09.348511 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32448): Terminating (SIGTERM) 06:04:09.559366 --- ParallelTerminationStrategy: PID 32448 died... 06:04:09.581049 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32448): Terminated: ok {rc=0} 06:04:09.669469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:trx-umtrx --------------------------------------------------------------------- 06:04:10.847052 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:10.851720 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:04:10.884508 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:04:10.911686 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 06:04:10.946867 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:04:10.980096 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:04:11.007343 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 06:04:11.536655 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 06:04:11.542023 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:11.553145 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 06:04:11.601482 tst assert_extension.py: using LAC 19439 06:04:11.724751 tst assert_extension.py: using RAC 59 06:04:11.848145 tst assert_extension.py: using CellId 19439 06:04:11.973046 tst assert_extension.py: using BVCI 19440 06:04:12.086876 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:12.097835 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:12.108777 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:12.119581 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:12.130402 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:04:12.141311 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 06:04:12.255168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:12.709968 run create_hlr_db(pid=32453): Launched 06:04:12.833415 bus /sierra_2: Setting Powered False 06:04:13.895871 run create_hlr_db(pid=32453): Terminated: ok {rc=0} 06:04:14.337969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32455): Launched 06:04:14.653517 run osmo-hlr_10.42.42.2(pid=32456): Launched 06:04:14.773548 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:15.323951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32458): Launched 06:04:15.637983 run osmo-stp_10.42.42.5(pid=32459): Launched 06:04:15.757239 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:16.412620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32461): Launched 06:04:16.742977 run osmo-msc_10.42.42.6(pid=32462): Launched 06:04:17.226845 run osmo-stp_10.42.42.5(pid=32459): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32459)] 06:04:17.481024 run osmo-stp_10.42.42.5(pid=32459): stdout: | (launched: 2022-12-09_06:04:15.581199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:17.612562 run osmo-stp_10.42.42.5(pid=32459): stderr: | 20221209060415770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060415770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060415771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060415771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060415773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060415774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060415774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:17.744242 run osmo-stp_10.42.42.5(pid=32459): stdout: | (launched: 2022-12-09_06:04:15.581199) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:17.869366 run osmo-stp_10.42.42.5(pid=32459): stderr: | 20221209060415770 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060415770 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060415771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060415771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060415773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060415774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060415774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:18.019393 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32459): Process ended prematurely: osmo-stp_10.42.42.5(pid=32459) [trial-2355↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32459)] [trial-2355↪ussd:trx-umtrx↪assert_extension.py:17] 06:04:18.028431 tst assert_extension.py:17: Test FAILED (6.5 sec) 06:04:18.055840 run osmo-hlr_10.42.42.2(pid=32456): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32456)] 06:04:18.106435 run osmo-hlr_10.42.42.2(pid=32456): stdout: | (launched: 2022-12-09_06:04:14.596525) 06:04:18.158443 run osmo-hlr_10.42.42.2(pid=32456): stderr: | 20221209060414796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060414797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060414797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060414797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060414797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060414797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060414808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060414816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060414817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060414817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:18.230770 run osmo-msc_10.42.42.6(pid=32462): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32462)] 06:04:18.281143 run osmo-msc_10.42.42.6(pid=32462): stdout: | (launched: 2022-12-09_06:04:16.674553) 06:04:18.333141 run osmo-msc_10.42.42.6(pid=32462): stderr: | 20221209060417152 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060417152 DLGLOBAL DEBUG validating counter group 0x7f3fb3eb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060417152 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060417152 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060417153 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060417153 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060417154 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060417155 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060417155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060417155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:18.386256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32455): Terminating (SIGTERM) 06:04:18.428551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32458): Terminating (SIGTERM) 06:04:18.470819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32461): Terminating (SIGTERM) 06:04:18.513289 --- ParallelTerminationStrategy: PID 32455 died... 06:04:18.533337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32455): Terminated: ok {rc=0} 06:04:18.580301 --- ParallelTerminationStrategy: PID 32458 died... 06:04:18.600062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32458): Terminated: ok {rc=0} 06:04:18.646533 --- ParallelTerminationStrategy: PID 32461 died... 06:04:18.666435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32461): Terminated: ok {rc=0} 06:04:18.754759 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:04:19.963802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:19.971310 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:04:20.004888 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:04:20.032194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:04:20.085092 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:04:20.118041 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:04:20.145191 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:04:20.697020 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:04:20.748674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:20.760177 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:04:20.829708 tst mo_mt_call.py: using LAC 19440 06:04:20.957774 tst mo_mt_call.py: using RAC 60 06:04:21.084008 tst mo_mt_call.py: using CellId 19440 06:04:21.212195 tst mo_mt_call.py: using BVCI 19441 06:04:21.328800 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:21.340327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:21.351561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:21.362901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:21.374274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:21.385614 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:21.499196 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:21.618440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:22.117151 run create_hlr_db(pid=32467): Launched 06:04:22.247584 bus /sierra_2: Setting Powered False 06:04:23.312067 run create_hlr_db(pid=32467): Terminated: ok {rc=0} 06:04:23.758335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32469): Launched 06:04:24.078790 run osmo-hlr_10.42.42.2(pid=32470): Launched 06:04:24.201474 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:24.753832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32472): Launched 06:04:25.073296 run osmo-stp_10.42.42.5(pid=32473): Launched 06:04:25.195619 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:25.776683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32475): Launched 06:04:26.097596 run osmo-msc_10.42.42.6(pid=32476): Launched 06:04:26.276480 run osmo-stp_10.42.42.5(pid=32473): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32473)] 06:04:26.412763 run osmo-stp_10.42.42.5(pid=32473): stdout: | (launched: 2022-12-09_06:04:25.014997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:26.548711 run osmo-stp_10.42.42.5(pid=32473): stderr: | 20221209060425204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060425205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060425205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060425206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060425206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060425206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060425206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:26.684144 run osmo-stp_10.42.42.5(pid=32473): stdout: | (launched: 2022-12-09_06:04:25.014997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:26.811781 run osmo-stp_10.42.42.5(pid=32473): stderr: | 20221209060425204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060425205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060425205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060425206 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060425206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060425206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060425206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:26.964411 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32473): Process ended prematurely: osmo-stp_10.42.42.5(pid=32473) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32473)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:04:26.974030 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:04:27.001690 run osmo-hlr_10.42.42.2(pid=32470): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32470)] 06:04:27.052413 run osmo-hlr_10.42.42.2(pid=32470): stdout: | (launched: 2022-12-09_06:04:24.020375) 06:04:27.105061 run osmo-hlr_10.42.42.2(pid=32470): stderr: | 20221209060424216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060424216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060424216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060424216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060424216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060424216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060424229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060424239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060424239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060424239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:27.177783 run osmo-msc_10.42.42.6(pid=32476): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32476)] 06:04:27.228312 run osmo-msc_10.42.42.6(pid=32476): stdout: | (launched: 2022-12-09_06:04:26.039135) 06:04:27.280412 run osmo-msc_10.42.42.6(pid=32476): stderr: | 20221209060426360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060426360 DLGLOBAL DEBUG validating counter group 0x7f4c13c2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060426361 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060426361 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060426361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060426361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060426363 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060426363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060426363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060426363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:27.332811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32469): Terminating (SIGTERM) 06:04:27.374901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32472): Terminating (SIGTERM) 06:04:27.417233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32475): Terminating (SIGTERM) 06:04:27.459569 --- ParallelTerminationStrategy: PID 32469 died... 06:04:27.479124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32469): Terminated: ok {rc=0} 06:04:27.525693 --- ParallelTerminationStrategy: PID 32472 died... 06:04:27.545309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32472): Terminated: ok {rc=0} 06:04:27.591709 --- ParallelTerminationStrategy: PID 32475 died... 06:04:27.611410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32475): Terminated: ok {rc=0} 06:04:27.700385 bus /sierra_3: Setting Powered False 06:04:28.800915 bus /sierra_3: Setting Powered False 06:04:29.916893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:04:31.071959 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.085175 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:04:31.156905 tst mo_mt_call_osmux.py: using LAC 19441 06:04:31.276561 tst mo_mt_call_osmux.py: using RAC 61 06:04:31.404194 tst mo_mt_call_osmux.py: using CellId 19441 06:04:31.533624 tst mo_mt_call_osmux.py: using BVCI 19442 06:04:31.645950 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.658100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.670478 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.683208 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.697413 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:04:31.709425 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:31.826486 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:04:31.968646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:32.500719 run create_hlr_db(pid=32478): Launched 06:04:32.630041 bus /sierra_2: Setting Powered False 06:04:33.693405 run create_hlr_db(pid=32478): Terminated: ok {rc=0} 06:04:34.118870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Launched 06:04:34.416029 run osmo-hlr_10.42.42.2(pid=32481): Launched 06:04:34.531067 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:35.058071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Launched 06:04:35.356211 run osmo-stp_10.42.42.5(pid=32484): Launched 06:04:35.470412 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:36.010601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Launched 06:04:36.309605 run osmo-msc_10.42.42.6(pid=32487): Launched 06:04:36.476768 run osmo-stp_10.42.42.5(pid=32484): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] 06:04:36.606048 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-09_06:04:35.301878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:36.734215 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221209060435472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060435472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060435472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060435473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060435473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060435473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060435473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:36.860028 run osmo-stp_10.42.42.5(pid=32484): stdout: | (launched: 2022-12-09_06:04:35.301878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:36.979102 run osmo-stp_10.42.42.5(pid=32484): stderr: | 20221209060435472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060435472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060435472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060435473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060435473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060435473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060435473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:37.122724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:04:37.131653 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:04:37.158248 run osmo-hlr_10.42.42.2(pid=32481): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32481)] 06:04:37.206364 run osmo-hlr_10.42.42.2(pid=32481): stdout: | (launched: 2022-12-09_06:04:34.362007) 06:04:37.256070 run osmo-hlr_10.42.42.2(pid=32481): stderr: | 20221209060434537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060434537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060434537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060434537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060434537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060434537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060434549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060434558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060434558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060434559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:37.325581 run osmo-msc_10.42.42.6(pid=32487): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32487)] 06:04:37.373263 run osmo-msc_10.42.42.6(pid=32487): stdout: | (launched: 2022-12-09_06:04:36.254656) 06:04:37.422743 run osmo-msc_10.42.42.6(pid=32487): stderr: | 20221209060436527 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060436527 DLGLOBAL DEBUG validating counter group 0x7fd258ecac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060436527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060436527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060436527 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060436528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060436529 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060436530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060436530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060436530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:37.472685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Terminating (SIGTERM) 06:04:37.517223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminating (SIGTERM) 06:04:37.559152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Terminating (SIGTERM) 06:04:37.601369 --- ParallelTerminationStrategy: PID 32480 died... 06:04:37.621374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32480): Terminated: ok {rc=0} 06:04:37.668138 --- ParallelTerminationStrategy: PID 32483 died... 06:04:37.687650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32483): Terminated: ok {rc=0} 06:04:37.733906 --- ParallelTerminationStrategy: PID 32486 died... 06:04:37.753589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32486): Terminated: ok {rc=0} 06:04:37.840619 bus /sierra_3: Setting Powered False 06:04:38.938579 bus /sierra_3: Setting Powered False 06:04:40.054705 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:04:41.307953 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:04:41.315318 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:04:41.348032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:04:41.374181 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:04:41.426784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:04:41.459372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:04:41.485780 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:04:42.033656 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:04:42.081612 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.092779 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:04:42.159912 tst mo_mt_call.py: using LAC 19442 06:04:42.277170 tst mo_mt_call.py: using RAC 62 06:04:42.399987 tst mo_mt_call.py: using CellId 19442 06:04:42.516822 tst mo_mt_call.py: using BVCI 19443 06:04:42.625760 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.636773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.647603 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.658761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.669991 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:42.681224 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:42.799397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:42.918961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:43.418340 run create_hlr_db(pid=32492): Launched 06:04:43.548787 bus /sierra_2: Setting Powered False 06:04:44.612722 run create_hlr_db(pid=32492): Terminated: ok {rc=0} 06:04:45.041687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32494): Launched 06:04:45.340651 run osmo-hlr_10.42.42.2(pid=32495): Launched 06:04:45.454773 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:46.010896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32497): Launched 06:04:46.393113 run osmo-stp_10.42.42.5(pid=32498): Launched 06:04:46.530992 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:47.265700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32500): Launched 06:04:47.592488 run osmo-msc_10.42.42.6(pid=32501): Launched 06:04:47.770641 run osmo-stp_10.42.42.5(pid=32498): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32498)] 06:04:47.907883 run osmo-stp_10.42.42.5(pid=32498): stdout: | (launched: 2022-12-09_06:04:46.329781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:48.043639 run osmo-stp_10.42.42.5(pid=32498): stderr: | 20221209060446740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060446740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060446740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060446740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060446743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060446743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060446743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:48.179587 run osmo-stp_10.42.42.5(pid=32498): stdout: | (launched: 2022-12-09_06:04:46.329781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:48.307176 run osmo-stp_10.42.42.5(pid=32498): stderr: | 20221209060446740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060446740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060446740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060446740 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060446743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060446743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060446743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:48.459794 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32498): Process ended prematurely: osmo-stp_10.42.42.5(pid=32498) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32498)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:04:48.469347 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:04:48.497145 run osmo-hlr_10.42.42.2(pid=32495): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32495)] 06:04:48.547087 run osmo-hlr_10.42.42.2(pid=32495): stdout: | (launched: 2022-12-09_06:04:45.286523) 06:04:48.598786 run osmo-hlr_10.42.42.2(pid=32495): stderr: | 20221209060445463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060445463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060445463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060445463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060445463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060445463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060445476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060445487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060445487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060445487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:48.670859 run osmo-msc_10.42.42.6(pid=32501): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32501)] 06:04:48.720720 run osmo-msc_10.42.42.6(pid=32501): stdout: | (launched: 2022-12-09_06:04:47.534611) 06:04:48.772364 run osmo-msc_10.42.42.6(pid=32501): stderr: | 20221209060447858 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060447858 DLGLOBAL DEBUG validating counter group 0x7f26b6afdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060447858 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060447858 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060447859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060447859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060447860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060447861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060447861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060447861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:48.824761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32494): Terminating (SIGTERM) 06:04:48.866666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32497): Terminating (SIGTERM) 06:04:48.908531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32500): Terminating (SIGTERM) 06:04:48.951289 --- ParallelTerminationStrategy: PID 32494 died... 06:04:48.971215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32494): Terminated: ok {rc=0} 06:04:49.017619 --- ParallelTerminationStrategy: PID 32497 died... 06:04:49.037327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32497): Terminated: ok {rc=0} 06:04:49.083699 --- ParallelTerminationStrategy: PID 32500 died... 06:04:49.103312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32500): Terminated: ok {rc=0} 06:04:49.191206 bus /sierra_3: Setting Powered False 06:04:50.291162 bus /sierra_3: Setting Powered False 06:04:51.407837 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:04:52.557034 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:52.569145 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:04:52.639416 tst mo_mt_call_osmux.py: using LAC 19443 06:04:52.767952 tst mo_mt_call_osmux.py: using RAC 63 06:04:52.900479 tst mo_mt_call_osmux.py: using CellId 19443 06:04:53.027613 tst mo_mt_call_osmux.py: using BVCI 19444 06:04:53.144613 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:53.156215 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:53.167491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:53.178774 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:53.190141 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:04:53.201508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:53.316178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:04:53.439786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:04:53.937338 run create_hlr_db(pid=32504): Launched 06:04:54.067475 bus /sierra_2: Setting Powered False 06:04:55.130347 run create_hlr_db(pid=32504): Terminated: ok {rc=0} 06:04:55.559663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Launched 06:04:55.858442 run osmo-hlr_10.42.42.2(pid=32507): Launched 06:04:55.972068 run osmo-stp_10.42.42.5: Starting osmo-stp 06:04:56.506254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Launched 06:04:56.803932 run osmo-stp_10.42.42.5(pid=32510): Launched 06:04:56.917817 run osmo-msc_10.42.42.6: Starting osmo-msc 06:04:57.458411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Launched 06:04:57.757036 run osmo-msc_10.42.42.6(pid=32513): Launched 06:04:57.924212 run osmo-stp_10.42.42.5(pid=32510): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] 06:04:58.052683 run osmo-stp_10.42.42.5(pid=32510): stdout: | (launched: 2022-12-09_06:04:56.749412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:58.180428 run osmo-stp_10.42.42.5(pid=32510): stderr: | 20221209060456921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060456921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060456921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060456922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060456922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060456922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060456922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:58.305418 run osmo-stp_10.42.42.5(pid=32510): stdout: | (launched: 2022-12-09_06:04:56.749412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:04:58.424755 run osmo-stp_10.42.42.5(pid=32510): stderr: | 20221209060456921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060456921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060456921 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060456922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060456922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060456922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060456922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:04:58.567120 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32510): Process ended prematurely: osmo-stp_10.42.42.5(pid=32510) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:04:58.575943 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:04:58.602552 run osmo-hlr_10.42.42.2(pid=32507): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32507)] 06:04:58.650651 run osmo-hlr_10.42.42.2(pid=32507): stdout: | (launched: 2022-12-09_06:04:55.803963) 06:04:58.700352 run osmo-hlr_10.42.42.2(pid=32507): stderr: | 20221209060455980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060455981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060455981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060455981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060455981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060455981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060455992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060456001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060456001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060456001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:04:58.769644 run osmo-msc_10.42.42.6(pid=32513): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32513)] 06:04:58.817466 run osmo-msc_10.42.42.6(pid=32513): stdout: | (launched: 2022-12-09_06:04:57.702332) 06:04:58.867290 run osmo-msc_10.42.42.6(pid=32513): stderr: | 20221209060457974 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060457974 DLGLOBAL DEBUG validating counter group 0x7fa3d1645c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060457974 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060457974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060457975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060457975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060457977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060457978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060457978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060457978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:04:58.917667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Terminating (SIGTERM) 06:04:58.957592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Terminating (SIGTERM) 06:04:58.997601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Terminating (SIGTERM) 06:04:59.037881 --- ParallelTerminationStrategy: PID 32506 died... 06:04:59.057030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32506): Terminated: ok {rc=0} 06:04:59.101453 --- ParallelTerminationStrategy: PID 32509 died... 06:04:59.119956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32509): Terminated: ok {rc=0} 06:04:59.164375 --- ParallelTerminationStrategy: PID 32512 died... 06:04:59.182935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32512): Terminated: ok {rc=0} 06:04:59.268683 bus /sierra_3: Setting Powered False 06:05:00.367821 bus /sierra_3: Setting Powered False 06:05:01.483675 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:05:02.728198 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:02.734322 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:05:02.766564 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:05:02.792465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:05:02.843700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:05:02.875566 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:05:02.902349 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:05:03.452227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:05:03.500689 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:03.511693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:05:03.579622 tst mo_mt_call.py: using LAC 19444 06:05:03.698616 tst mo_mt_call.py: using RAC 64 06:05:03.817384 tst mo_mt_call.py: using CellId 19444 06:05:03.946263 tst mo_mt_call.py: using BVCI 19445 06:05:04.065608 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:04.077437 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:04.089186 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:04.100543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:04.112048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:04.123491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:04.240908 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:04.354062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:04.819537 run create_hlr_db(pid=32521): Launched 06:05:04.935238 bus /sierra_2: Setting Powered False 06:05:05.995258 run create_hlr_db(pid=32521): Terminated: ok {rc=0} 06:05:06.413921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32523): Launched 06:05:06.712790 run osmo-hlr_10.42.42.2(pid=32524): Launched 06:05:06.827281 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:07.342876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32526): Launched 06:05:07.642391 run osmo-stp_10.42.42.5(pid=32527): Launched 06:05:07.756603 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:08.298053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32529): Launched 06:05:08.596817 run osmo-msc_10.42.42.6(pid=32530): Launched 06:05:08.765254 run osmo-stp_10.42.42.5(pid=32527): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32527)] 06:05:08.894106 run osmo-stp_10.42.42.5(pid=32527): stdout: | (launched: 2022-12-09_06:05:07.587604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:09.022746 run osmo-stp_10.42.42.5(pid=32527): stderr: | 20221209060507758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060507759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060507759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060507759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060507760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060507760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060507760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:09.148811 run osmo-stp_10.42.42.5(pid=32527): stdout: | (launched: 2022-12-09_06:05:07.587604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:09.268030 run osmo-stp_10.42.42.5(pid=32527): stderr: | 20221209060507758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060507759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060507759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060507759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060507760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060507760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060507760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:09.411114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32527): Process ended prematurely: osmo-stp_10.42.42.5(pid=32527) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32527)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:05:09.419975 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:05:09.447098 run osmo-hlr_10.42.42.2(pid=32524): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32524)] 06:05:09.495484 run osmo-hlr_10.42.42.2(pid=32524): stdout: | (launched: 2022-12-09_06:05:06.658183) 06:05:09.545950 run osmo-hlr_10.42.42.2(pid=32524): stderr: | 20221209060506832 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060506832 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060506832 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060506832 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060506832 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060506832 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060506845 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060506853 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060506853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060506853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:09.615933 run osmo-msc_10.42.42.6(pid=32530): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32530)] 06:05:09.664372 run osmo-msc_10.42.42.6(pid=32530): stdout: | (launched: 2022-12-09_06:05:08.542496) 06:05:09.714658 run osmo-msc_10.42.42.6(pid=32530): stderr: | 20221209060508811 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060508812 DLGLOBAL DEBUG validating counter group 0x7f42b5dd7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060508812 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060508812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060508812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060508812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060508814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060508814 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060508814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060508814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:09.765242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32523): Terminating (SIGTERM) 06:05:09.805953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32526): Terminating (SIGTERM) 06:05:09.846522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32529): Terminating (SIGTERM) 06:05:09.887238 --- ParallelTerminationStrategy: PID 32523 died... 06:05:09.906601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32523): Terminated: ok {rc=0} 06:05:09.951699 --- ParallelTerminationStrategy: PID 32526 died... 06:05:09.970624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32526): Terminated: ok {rc=0} 06:05:10.015439 --- ParallelTerminationStrategy: PID 32529 died... 06:05:10.034289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32529): Terminated: ok {rc=0} 06:05:10.121018 bus /sierra_3: Setting Powered False 06:05:11.221473 bus /sierra_3: Setting Powered False 06:05:12.338163 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:05:13.484675 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:13.496243 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:05:13.564403 tst mo_mt_call_osmux.py: using LAC 19445 06:05:13.683185 tst mo_mt_call_osmux.py: using RAC 65 06:05:13.802229 tst mo_mt_call_osmux.py: using CellId 19445 06:05:13.922304 tst mo_mt_call_osmux.py: using BVCI 19446 06:05:14.040917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:14.052672 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:14.064141 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:14.076133 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:14.088364 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:05:14.100732 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:14.217860 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:05:14.332814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:14.796570 run create_hlr_db(pid=32532): Launched 06:05:14.911717 bus /sierra_2: Setting Powered False 06:05:15.976614 run create_hlr_db(pid=32532): Terminated: ok {rc=0} 06:05:16.449050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32534): Launched 06:05:16.800374 run osmo-hlr_10.42.42.2(pid=32535): Launched 06:05:16.997414 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:17.682815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32537): Launched 06:05:18.004791 run osmo-stp_10.42.42.5(pid=32538): Launched 06:05:18.127603 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:18.708014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32540): Launched 06:05:19.028581 run osmo-msc_10.42.42.6(pid=32541): Launched 06:05:19.207662 run osmo-stp_10.42.42.5(pid=32538): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32538)] 06:05:19.344749 run osmo-stp_10.42.42.5(pid=32538): stdout: | (launched: 2022-12-09_06:05:17.946565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:19.480708 run osmo-stp_10.42.42.5(pid=32538): stderr: | 20221209060518137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060518138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060518138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060518138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060518139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060518139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060518139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:19.616355 run osmo-stp_10.42.42.5(pid=32538): stdout: | (launched: 2022-12-09_06:05:17.946565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:19.744034 run osmo-stp_10.42.42.5(pid=32538): stderr: | 20221209060518137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060518138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060518138 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060518138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060518139 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060518139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060518139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:19.896932 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32538): Process ended prematurely: osmo-stp_10.42.42.5(pid=32538) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32538)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:05:19.906614 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:05:19.934750 run osmo-hlr_10.42.42.2(pid=32535): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32535)] 06:05:19.985369 run osmo-hlr_10.42.42.2(pid=32535): stdout: | (launched: 2022-12-09_06:05:16.733028) 06:05:20.037713 run osmo-hlr_10.42.42.2(pid=32535): stderr: | 20221209060517120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060517120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060517120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060517120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060517120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060517120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060517147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060517167 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060517167 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060517167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:20.111166 run osmo-msc_10.42.42.6(pid=32541): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32541)] 06:05:20.161781 run osmo-msc_10.42.42.6(pid=32541): stdout: | (launched: 2022-12-09_06:05:18.970396) 06:05:20.213991 run osmo-msc_10.42.42.6(pid=32541): stderr: | 20221209060519291 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060519291 DLGLOBAL DEBUG validating counter group 0x7fb35cee1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060519291 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060519291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060519291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060519292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060519293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060519294 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060519294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060519294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:20.266588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32534): Terminating (SIGTERM) 06:05:20.309049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32537): Terminating (SIGTERM) 06:05:20.351819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32540): Terminating (SIGTERM) 06:05:20.394809 --- ParallelTerminationStrategy: PID 32534 died... 06:05:20.414965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32534): Terminated: ok {rc=0} 06:05:20.462030 --- ParallelTerminationStrategy: PID 32537 died... 06:05:20.481968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32537): Terminated: ok {rc=0} 06:05:20.528473 --- ParallelTerminationStrategy: PID 32540 died... 06:05:20.548219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32540): Terminated: ok {rc=0} 06:05:20.637998 bus /sierra_3: Setting Powered False 06:05:21.737672 bus /sierra_3: Setting Powered False 06:05:22.853696 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:05:24.108466 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:24.115510 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:05:24.148514 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:05:24.175977 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:05:24.230815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:05:24.264187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:05:24.290505 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:05:24.845263 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:05:24.898005 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:24.909680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:05:24.977698 tst mo_mt_call.py: using LAC 19446 06:05:25.103057 tst mo_mt_call.py: using RAC 66 06:05:25.227883 tst mo_mt_call.py: using CellId 19446 06:05:25.353703 tst mo_mt_call.py: using BVCI 19447 06:05:25.470717 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:25.482265 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:25.493670 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:25.504903 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:25.516325 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:25.527603 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:25.641410 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:25.760327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:26.225692 run create_hlr_db(pid=32546): Launched 06:05:26.340858 bus /sierra_2: Setting Powered False 06:05:27.401194 run create_hlr_db(pid=32546): Terminated: ok {rc=0} 06:05:27.840414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Launched 06:05:28.162634 run osmo-hlr_10.42.42.2(pid=32549): Launched 06:05:28.284665 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:28.838174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Launched 06:05:29.159776 run osmo-stp_10.42.42.5(pid=32552): Launched 06:05:29.281756 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:29.862189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32554): Launched 06:05:30.183137 run osmo-msc_10.42.42.6(pid=32555): Launched 06:05:30.361516 run osmo-stp_10.42.42.5(pid=32552): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] 06:05:30.498694 run osmo-stp_10.42.42.5(pid=32552): stdout: | (launched: 2022-12-09_06:05:29.101471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:30.634499 run osmo-stp_10.42.42.5(pid=32552): stderr: | 20221209060529294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060529294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060529295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060529295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060529295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060529295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060529295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:30.769636 run osmo-stp_10.42.42.5(pid=32552): stdout: | (launched: 2022-12-09_06:05:29.101471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:30.914788 run osmo-stp_10.42.42.5(pid=32552): stderr: | 20221209060529294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060529294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060529295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060529295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060529295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060529295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060529295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:31.070560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32552): Process ended prematurely: osmo-stp_10.42.42.5(pid=32552) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:05:31.080227 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:05:31.108800 run osmo-hlr_10.42.42.2(pid=32549): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32549)] 06:05:31.161316 run osmo-hlr_10.42.42.2(pid=32549): stdout: | (launched: 2022-12-09_06:05:28.104159) 06:05:31.214144 run osmo-hlr_10.42.42.2(pid=32549): stderr: | 20221209060528304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060528304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060528304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060528304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060528304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060528304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060528316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060528324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060528325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060528325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:31.287505 run osmo-msc_10.42.42.6(pid=32555): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32555)] 06:05:31.338539 run osmo-msc_10.42.42.6(pid=32555): stdout: | (launched: 2022-12-09_06:05:30.124746) 06:05:31.391766 run osmo-msc_10.42.42.6(pid=32555): stderr: | 20221209060530447 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060530447 DLGLOBAL DEBUG validating counter group 0x7f9944d36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060530447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060530447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060530448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060530448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060530451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060530452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060530452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060530452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:31.444759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Terminating (SIGTERM) 06:05:31.487786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Terminating (SIGTERM) 06:05:31.532124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32554): Terminating (SIGTERM) 06:05:31.574768 --- ParallelTerminationStrategy: PID 32548 died... 06:05:31.594864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32548): Terminated: ok {rc=0} 06:05:31.641453 --- ParallelTerminationStrategy: PID 32551 died... 06:05:31.661531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32551): Terminated: ok {rc=0} 06:05:31.708134 --- ParallelTerminationStrategy: PID 32554 died... 06:05:31.728350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32554): Terminated: ok {rc=0} 06:05:31.817986 bus /sierra_3: Setting Powered False 06:05:32.917499 bus /sierra_3: Setting Powered False 06:05:34.031654 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:05:35.173960 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.185664 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:05:35.258504 tst mo_mt_call_osmux.py: using LAC 19447 06:05:35.376644 tst mo_mt_call_osmux.py: using RAC 67 06:05:35.492453 tst mo_mt_call_osmux.py: using CellId 19447 06:05:35.609063 tst mo_mt_call_osmux.py: using BVCI 19448 06:05:35.717279 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.728300 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.739180 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.750435 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.761728 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:05:35.772706 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:35.891337 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:05:36.011535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:36.510795 run create_hlr_db(pid=32557): Launched 06:05:36.642401 bus /sierra_2: Setting Powered False 06:05:37.706511 run create_hlr_db(pid=32557): Terminated: ok {rc=0} 06:05:38.154572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Launched 06:05:38.474403 run osmo-hlr_10.42.42.2(pid=32560): Launched 06:05:38.595665 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:39.146199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Launched 06:05:39.467020 run osmo-stp_10.42.42.5(pid=32563): Launched 06:05:39.589048 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:40.170196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32565): Launched 06:05:40.489621 run osmo-msc_10.42.42.6(pid=32566): Launched 06:05:40.668905 run osmo-stp_10.42.42.5(pid=32563): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] 06:05:40.805293 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-09_06:05:39.409010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:40.941481 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221209060539601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060539601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060539602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060539602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060539602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060539602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060539603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:41.077022 run osmo-stp_10.42.42.5(pid=32563): stdout: | (launched: 2022-12-09_06:05:39.409010) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:41.205166 run osmo-stp_10.42.42.5(pid=32563): stderr: | 20221209060539601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060539601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060539602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060539602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060539602 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060539602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060539603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:41.357921 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:05:41.367327 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:05:41.395078 run osmo-hlr_10.42.42.2(pid=32560): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32560)] 06:05:41.445182 run osmo-hlr_10.42.42.2(pid=32560): stdout: | (launched: 2022-12-09_06:05:38.416189) 06:05:41.497096 run osmo-hlr_10.42.42.2(pid=32560): stderr: | 20221209060538615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060538615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060538615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060538615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060538615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060538615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060538628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060538636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060538636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060538636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:41.569433 run osmo-msc_10.42.42.6(pid=32566): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32566)] 06:05:41.619504 run osmo-msc_10.42.42.6(pid=32566): stdout: | (launched: 2022-12-09_06:05:40.431592) 06:05:41.671138 run osmo-msc_10.42.42.6(pid=32566): stderr: | 20221209060540752 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060540752 DLGLOBAL DEBUG validating counter group 0x7efc79459c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060540752 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060540752 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060540752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060540752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060540754 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060540755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060540755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060540755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:41.723043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminating (SIGTERM) 06:05:41.764613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminating (SIGTERM) 06:05:41.806550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32565): Terminating (SIGTERM) 06:05:41.848611 --- ParallelTerminationStrategy: PID 32559 died... 06:05:41.868673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminated: ok {rc=0} 06:05:41.914800 --- ParallelTerminationStrategy: PID 32562 died... 06:05:41.934341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32562): Terminated: ok {rc=0} 06:05:41.980323 --- ParallelTerminationStrategy: PID 32565 died... 06:05:41.999985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32565): Terminated: ok {rc=0} 06:05:42.087784 bus /sierra_3: Setting Powered False 06:05:43.185927 bus /sierra_3: Setting Powered False 06:05:44.300521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:05:45.561052 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:05:45.567428 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:05:45.600107 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:05:45.626417 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:05:45.683565 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:05:45.717799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:05:45.745018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:05:46.288637 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:05:46.341773 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:46.354255 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:05:46.425491 tst mo_mt_call.py: using LAC 19448 06:05:46.566581 tst mo_mt_call.py: using RAC 68 06:05:46.695087 tst mo_mt_call.py: using CellId 19448 06:05:46.834818 tst mo_mt_call.py: using BVCI 19449 06:05:46.950360 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:46.962571 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:46.974530 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:46.988900 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:47.002060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:47.013946 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:47.136436 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:47.260069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:47.758980 run create_hlr_db(pid=32571): Launched 06:05:47.888834 bus /sierra_2: Setting Powered False 06:05:48.952697 run create_hlr_db(pid=32571): Terminated: ok {rc=0} 06:05:49.379359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32573): Launched 06:05:49.677961 run osmo-hlr_10.42.42.2(pid=32574): Launched 06:05:49.791635 run osmo-stp_10.42.42.5: Starting osmo-stp 06:05:50.304596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32576): Launched 06:05:50.603244 run osmo-stp_10.42.42.5(pid=32577): Launched 06:05:50.716909 run osmo-msc_10.42.42.6: Starting osmo-msc 06:05:51.257696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32579): Launched 06:05:51.556209 run osmo-msc_10.42.42.6(pid=32580): Launched 06:05:51.723741 run osmo-stp_10.42.42.5(pid=32577): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32577)] 06:05:51.852296 run osmo-stp_10.42.42.5(pid=32577): stdout: | (launched: 2022-12-09_06:05:50.549115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:51.980312 run osmo-stp_10.42.42.5(pid=32577): stderr: | 20221209060550717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060550717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060550717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060550717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060550720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060550720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060550720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:52.105688 run osmo-stp_10.42.42.5(pid=32577): stdout: | (launched: 2022-12-09_06:05:50.549115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:05:52.224813 run osmo-stp_10.42.42.5(pid=32577): stderr: | 20221209060550717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060550717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060550717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060550717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060550720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060550720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060550720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:05:52.367259 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32577): Process ended prematurely: osmo-stp_10.42.42.5(pid=32577) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32577)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:05:52.376379 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:05:52.403466 run osmo-hlr_10.42.42.2(pid=32574): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32574)] 06:05:52.451886 run osmo-hlr_10.42.42.2(pid=32574): stdout: | (launched: 2022-12-09_06:05:49.623350) 06:05:52.502351 run osmo-hlr_10.42.42.2(pid=32574): stderr: | 20221209060549797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060549797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060549797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060549797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060549797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060549797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060549812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060549823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060549823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060549823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:05:52.572097 run osmo-msc_10.42.42.6(pid=32580): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32580)] 06:05:52.620498 run osmo-msc_10.42.42.6(pid=32580): stdout: | (launched: 2022-12-09_06:05:51.501816) 06:05:52.670580 run osmo-msc_10.42.42.6(pid=32580): stderr: | 20221209060551774 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060551774 DLGLOBAL DEBUG validating counter group 0x7efd3fa13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060551774 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060551774 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060551775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060551775 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060551777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060551777 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060551778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060551778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:05:52.721082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32573): Terminating (SIGTERM) 06:05:52.761633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32576): Terminating (SIGTERM) 06:05:52.802345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32579): Terminating (SIGTERM) 06:05:52.843182 --- ParallelTerminationStrategy: PID 32573 died... 06:05:52.862475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32573): Terminated: ok {rc=0} 06:05:52.907467 --- ParallelTerminationStrategy: PID 32576 died... 06:05:52.926343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32576): Terminated: ok {rc=0} 06:05:52.971317 --- ParallelTerminationStrategy: PID 32579 died... 06:05:52.990209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32579): Terminated: ok {rc=0} 06:05:53.078157 bus /sierra_3: Setting Powered False 06:05:54.179464 bus /sierra_3: Setting Powered False 06:05:55.296844 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:05:56.450381 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:56.462505 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:05:56.533556 tst mo_mt_call_osmux.py: using LAC 19449 06:05:56.659474 tst mo_mt_call_osmux.py: using RAC 69 06:05:56.788905 tst mo_mt_call_osmux.py: using CellId 19449 06:05:56.914170 tst mo_mt_call_osmux.py: using BVCI 19450 06:05:57.030640 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:57.042255 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:57.053616 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:57.064772 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:57.076310 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:05:57.087754 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:57.222089 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:05:57.339085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:05:57.840440 run create_hlr_db(pid=32582): Launched 06:05:57.971065 bus /sierra_2: Setting Powered False 06:05:59.034487 run create_hlr_db(pid=32582): Terminated: ok {rc=0} 06:05:59.481415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32584): Launched 06:05:59.802346 run osmo-hlr_10.42.42.2(pid=32585): Launched 06:05:59.925190 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:00.477628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32587): Launched 06:06:00.796868 run osmo-stp_10.42.42.5(pid=32588): Launched 06:06:00.983859 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:01.832140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32590): Launched 06:06:02.171079 run osmo-msc_10.42.42.6(pid=32591): Launched 06:06:02.462682 run osmo-stp_10.42.42.5(pid=32588): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32588)] 06:06:02.596698 run osmo-stp_10.42.42.5(pid=32588): stdout: | (launched: 2022-12-09_06:06:00.739063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:02.723384 run osmo-stp_10.42.42.5(pid=32588): stderr: | 20221209060601038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060601038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060601039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060601039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060601039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060601040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060601040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:02.849194 run osmo-stp_10.42.42.5(pid=32588): stdout: | (launched: 2022-12-09_06:06:00.739063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:02.968477 run osmo-stp_10.42.42.5(pid=32588): stderr: | 20221209060601038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060601038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060601039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060601039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060601039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060601040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060601040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:03.111346 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32588): Process ended prematurely: osmo-stp_10.42.42.5(pid=32588) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32588)] [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:06:03.120474 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 06:06:03.147765 run osmo-hlr_10.42.42.2(pid=32585): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32585)] 06:06:03.195910 run osmo-hlr_10.42.42.2(pid=32585): stdout: | (launched: 2022-12-09_06:05:59.743924) 06:06:03.246003 run osmo-hlr_10.42.42.2(pid=32585): stderr: | 20221209060559942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060559942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060559942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060559942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060559942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060559942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060559967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060559978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060559979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060559979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:03.316173 run osmo-msc_10.42.42.6(pid=32591): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32591)] 06:06:03.364412 run osmo-msc_10.42.42.6(pid=32591): stdout: | (launched: 2022-12-09_06:06:02.106795) 06:06:03.415105 run osmo-msc_10.42.42.6(pid=32591): stderr: | 20221209060602484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060602484 DLGLOBAL DEBUG validating counter group 0x7f7afb075c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060602485 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060602485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060602485 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060602485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060602487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060602487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060602487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060602487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:03.465288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32584): Terminating (SIGTERM) 06:06:03.505446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32587): Terminating (SIGTERM) 06:06:03.545869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32590): Terminating (SIGTERM) 06:06:03.586742 --- ParallelTerminationStrategy: PID 32584 died... 06:06:03.606161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32584): Terminated: ok {rc=0} 06:06:03.651294 --- ParallelTerminationStrategy: PID 32587 died... 06:06:03.670260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32587): Terminated: ok {rc=0} 06:06:03.715108 --- ParallelTerminationStrategy: PID 32590 died... 06:06:03.733940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32590): Terminated: ok {rc=0} 06:06:03.820439 bus /sierra_3: Setting Powered False 06:06:04.920074 bus /sierra_3: Setting Powered False 06:06:06.036161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:06:07.296826 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:07.305332 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:06:07.338852 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:06:07.365872 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:06:07.416072 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:06:07.449128 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:06:07.476323 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:06:08.033639 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:06:08.084658 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.096008 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:06:08.163705 tst mo_mt_call.py: using LAC 19450 06:06:08.284125 tst mo_mt_call.py: using RAC 70 06:06:08.402593 tst mo_mt_call.py: using CellId 19450 06:06:08.519975 tst mo_mt_call.py: using BVCI 19451 06:06:08.630099 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.641154 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.652072 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.663223 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.674407 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:08.685535 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:08.801659 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:08.920476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:09.420803 run create_hlr_db(pid=32596): Launched 06:06:09.552266 bus /sierra_2: Setting Powered False 06:06:10.615847 run create_hlr_db(pid=32596): Terminated: ok {rc=0} 06:06:11.043489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32598): Launched 06:06:11.341944 run osmo-hlr_10.42.42.2(pid=32599): Launched 06:06:11.455711 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:11.969292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32601): Launched 06:06:12.268444 run osmo-stp_10.42.42.5(pid=32602): Launched 06:06:12.382512 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:12.922380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32604): Launched 06:06:13.220789 run osmo-msc_10.42.42.6(pid=32605): Launched 06:06:13.388584 run osmo-stp_10.42.42.5(pid=32602): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32602)] 06:06:13.517340 run osmo-stp_10.42.42.5(pid=32602): stdout: | (launched: 2022-12-09_06:06:12.213923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:13.644621 run osmo-stp_10.42.42.5(pid=32602): stderr: | 20221209060612384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060612384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060612385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060612385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060612386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060612386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060612386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:13.769595 run osmo-stp_10.42.42.5(pid=32602): stdout: | (launched: 2022-12-09_06:06:12.213923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:13.888256 run osmo-stp_10.42.42.5(pid=32602): stderr: | 20221209060612384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060612384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060612385 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060612385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060612386 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060612386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060612386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:14.030694 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32602): Process ended prematurely: osmo-stp_10.42.42.5(pid=32602) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32602)] [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:06:14.039496 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:06:14.066146 run osmo-hlr_10.42.42.2(pid=32599): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32599)] 06:06:14.114359 run osmo-hlr_10.42.42.2(pid=32599): stdout: | (launched: 2022-12-09_06:06:11.287780) 06:06:14.163888 run osmo-hlr_10.42.42.2(pid=32599): stderr: | 20221209060611462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060611462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060611462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060611462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060611462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060611462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060611556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060611565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060611566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060611566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:14.232853 run osmo-msc_10.42.42.6(pid=32605): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32605)] 06:06:14.280373 run osmo-msc_10.42.42.6(pid=32605): stdout: | (launched: 2022-12-09_06:06:13.166116) 06:06:14.329707 run osmo-msc_10.42.42.6(pid=32605): stderr: | 20221209060613435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060613436 DLGLOBAL DEBUG validating counter group 0x7fdd4a846c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060613436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060613436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060613436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060613436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060613438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060613438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060613438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060613439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:14.379533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32598): Terminating (SIGTERM) 06:06:14.419519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32601): Terminating (SIGTERM) 06:06:14.459502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32604): Terminating (SIGTERM) 06:06:14.499802 --- ParallelTerminationStrategy: PID 32598 died... 06:06:14.518950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32598): Terminated: ok {rc=0} 06:06:14.563527 --- ParallelTerminationStrategy: PID 32601 died... 06:06:14.582268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32601): Terminated: ok {rc=0} 06:06:14.626509 --- ParallelTerminationStrategy: PID 32604 died... 06:06:14.645273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32604): Terminated: ok {rc=0} 06:06:14.729239 bus /sierra_3: Setting Powered False 06:06:15.824936 bus /sierra_3: Setting Powered False 06:06:16.956530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:06:18.109456 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.121378 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:06:18.190490 tst mo_mt_call_osmux.py: using LAC 19451 06:06:18.307423 tst mo_mt_call_osmux.py: using RAC 71 06:06:18.426606 tst mo_mt_call_osmux.py: using CellId 19451 06:06:18.545195 tst mo_mt_call_osmux.py: using BVCI 19452 06:06:18.654871 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.666252 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.677196 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.688397 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.699712 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:06:18.711012 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:18.826372 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:06:18.945343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:19.445692 run create_hlr_db(pid=32607): Launched 06:06:19.576125 bus /sierra_2: Setting Powered False 06:06:20.640289 run create_hlr_db(pid=32607): Terminated: ok {rc=0} 06:06:21.067356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32609): Launched 06:06:21.366562 run osmo-hlr_10.42.42.2(pid=32610): Launched 06:06:21.479770 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:22.029036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32612): Launched 06:06:22.327197 run osmo-stp_10.42.42.5(pid=32613): Launched 06:06:22.440728 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:22.980510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32615): Launched 06:06:23.279767 run osmo-msc_10.42.42.6(pid=32616): Launched 06:06:23.447147 run osmo-stp_10.42.42.5(pid=32613): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32613)] 06:06:23.576423 run osmo-stp_10.42.42.5(pid=32613): stdout: | (launched: 2022-12-09_06:06:22.272458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:23.704214 run osmo-stp_10.42.42.5(pid=32613): stderr: | 20221209060622442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060622442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060622443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060622443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060622444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060622444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060622444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:23.829475 run osmo-stp_10.42.42.5(pid=32613): stdout: | (launched: 2022-12-09_06:06:22.272458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:23.948362 run osmo-stp_10.42.42.5(pid=32613): stderr: | 20221209060622442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060622442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060622443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060622443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060622444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060622444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060622444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:24.090995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32613): Process ended prematurely: osmo-stp_10.42.42.5(pid=32613) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32613)] [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:06:24.100050 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:06:24.126999 run osmo-hlr_10.42.42.2(pid=32610): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32610)] 06:06:24.175137 run osmo-hlr_10.42.42.2(pid=32610): stdout: | (launched: 2022-12-09_06:06:21.311760) 06:06:24.224926 run osmo-hlr_10.42.42.2(pid=32610): stderr: | 20221209060621486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060621486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060621486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060621486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060621486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060621486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060621498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060621509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060621509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060621510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:24.294329 run osmo-msc_10.42.42.6(pid=32616): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32616)] 06:06:24.342146 run osmo-msc_10.42.42.6(pid=32616): stdout: | (launched: 2022-12-09_06:06:23.225173) 06:06:24.391638 run osmo-msc_10.42.42.6(pid=32616): stderr: | 20221209060623499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060623499 DLGLOBAL DEBUG validating counter group 0x7f8cd6ee2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060623499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060623500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060623500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060623500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060623502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060623502 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060623502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060623502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:24.441516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32609): Terminating (SIGTERM) 06:06:24.481732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32612): Terminating (SIGTERM) 06:06:24.521881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32615): Terminating (SIGTERM) 06:06:24.562427 --- ParallelTerminationStrategy: PID 32609 died... 06:06:24.581563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32609): Terminated: ok {rc=0} 06:06:24.626362 --- ParallelTerminationStrategy: PID 32612 died... 06:06:24.645164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32612): Terminated: ok {rc=0} 06:06:24.689787 --- ParallelTerminationStrategy: PID 32615 died... 06:06:24.708485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32615): Terminated: ok {rc=0} 06:06:24.795217 bus /sierra_3: Setting Powered False 06:06:25.893447 bus /sierra_3: Setting Powered False 06:06:27.009290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:06:28.253631 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:28.259201 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:06:28.291977 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:06:28.319335 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:06:28.368463 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:06:28.400602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:06:28.426712 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:06:28.977213 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:06:29.025451 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.036142 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:06:29.106329 tst mo_mt_call.py: using LAC 19452 06:06:29.223846 tst mo_mt_call.py: using RAC 72 06:06:29.339394 tst mo_mt_call.py: using CellId 19452 06:06:29.459455 tst mo_mt_call.py: using BVCI 19453 06:06:29.567587 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.578648 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.589692 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.600717 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.611657 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:29.622805 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:29.740281 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:29.858969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:30.358612 run create_hlr_db(pid=32621): Launched 06:06:30.489587 bus /sierra_2: Setting Powered False 06:06:31.551288 run create_hlr_db(pid=32621): Terminated: ok {rc=0} 06:06:32.021679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Launched 06:06:32.348307 run osmo-hlr_10.42.42.2(pid=32624): Launched 06:06:32.470916 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:33.021780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Launched 06:06:33.342555 run osmo-stp_10.42.42.5(pid=32627): Launched 06:06:33.463771 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:34.042767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32629): Launched 06:06:34.363348 run osmo-msc_10.42.42.6(pid=32630): Launched 06:06:34.541910 run osmo-stp_10.42.42.5(pid=32627): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] 06:06:34.678392 run osmo-stp_10.42.42.5(pid=32627): stdout: | (launched: 2022-12-09_06:06:33.284177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:34.814333 run osmo-stp_10.42.42.5(pid=32627): stderr: | 20221209060633474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060633475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060633475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060633475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060633478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060633478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060633478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:34.948881 run osmo-stp_10.42.42.5(pid=32627): stdout: | (launched: 2022-12-09_06:06:33.284177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:35.076356 run osmo-stp_10.42.42.5(pid=32627): stderr: | 20221209060633474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060633475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060633475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060633475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060633478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060633478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060633478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:35.229652 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32627): Process ended prematurely: osmo-stp_10.42.42.5(pid=32627) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:06:35.238992 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:06:35.266478 run osmo-hlr_10.42.42.2(pid=32624): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32624)] 06:06:35.316381 run osmo-hlr_10.42.42.2(pid=32624): stdout: | (launched: 2022-12-09_06:06:32.289963) 06:06:35.368058 run osmo-hlr_10.42.42.2(pid=32624): stderr: | 20221209060632487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060632487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060632487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060632487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060632487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060632487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060632499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060632507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060632507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060632507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:35.440100 run osmo-msc_10.42.42.6(pid=32630): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32630)] 06:06:35.490155 run osmo-msc_10.42.42.6(pid=32630): stdout: | (launched: 2022-12-09_06:06:34.305234) 06:06:35.541828 run osmo-msc_10.42.42.6(pid=32630): stderr: | 20221209060634627 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060634627 DLGLOBAL DEBUG validating counter group 0x7f935cf87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060634627 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060634627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060634627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060634628 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060634629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060634630 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060634630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060634630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:35.593893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Terminating (SIGTERM) 06:06:35.635586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Terminating (SIGTERM) 06:06:35.677516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32629): Terminating (SIGTERM) 06:06:35.719570 --- ParallelTerminationStrategy: PID 32623 died... 06:06:35.740223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32623): Terminated: ok {rc=0} 06:06:35.786453 --- ParallelTerminationStrategy: PID 32626 died... 06:06:35.806475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32626): Terminated: ok {rc=0} 06:06:35.852334 --- ParallelTerminationStrategy: PID 32629 died... 06:06:35.871944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32629): Terminated: ok {rc=0} 06:06:35.960785 bus /sierra_3: Setting Powered False 06:06:37.060341 bus /sierra_3: Setting Powered False 06:06:38.176172 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:06:39.324942 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.336997 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:06:39.408191 tst mo_mt_call_osmux.py: using LAC 19453 06:06:39.534365 tst mo_mt_call_osmux.py: using RAC 73 06:06:39.661210 tst mo_mt_call_osmux.py: using CellId 19453 06:06:39.787914 tst mo_mt_call_osmux.py: using BVCI 19454 06:06:39.898820 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.909903 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.920703 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.931587 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.942686 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:06:39.953887 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:40.071847 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:06:40.193085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:40.693841 run create_hlr_db(pid=32633): Launched 06:06:40.809621 bus /sierra_2: Setting Powered False 06:06:41.869904 run create_hlr_db(pid=32633): Terminated: ok {rc=0} 06:06:42.287021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32635): Launched 06:06:42.585923 run osmo-hlr_10.42.42.2(pid=32636): Launched 06:06:42.699647 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:43.244474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32638): Launched 06:06:43.565177 run osmo-stp_10.42.42.5(pid=32639): Launched 06:06:43.688380 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:44.275613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32641): Launched 06:06:44.597658 run osmo-msc_10.42.42.6(pid=32642): Launched 06:06:44.776436 run osmo-stp_10.42.42.5(pid=32639): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32639)] 06:06:44.912905 run osmo-stp_10.42.42.5(pid=32639): stdout: | (launched: 2022-12-09_06:06:43.506893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:45.049412 run osmo-stp_10.42.42.5(pid=32639): stderr: | 20221209060643701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060643702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060643702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060643702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060643703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060643703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060643703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:45.185512 run osmo-stp_10.42.42.5(pid=32639): stdout: | (launched: 2022-12-09_06:06:43.506893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:45.313467 run osmo-stp_10.42.42.5(pid=32639): stderr: | 20221209060643701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060643702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060643702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060643702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060643703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060643703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060643703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:45.466860 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32639): Process ended prematurely: osmo-stp_10.42.42.5(pid=32639) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32639)] [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:06:45.476231 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:06:45.504167 run osmo-hlr_10.42.42.2(pid=32636): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32636)] 06:06:45.554229 run osmo-hlr_10.42.42.2(pid=32636): stdout: | (launched: 2022-12-09_06:06:42.531360) 06:06:45.606125 run osmo-hlr_10.42.42.2(pid=32636): stderr: | 20221209060642708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060642708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060642708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060642708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060642708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060642708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060642721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060642729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060642729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060642729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:45.678365 run osmo-msc_10.42.42.6(pid=32642): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32642)] 06:06:45.728746 run osmo-msc_10.42.42.6(pid=32642): stdout: | (launched: 2022-12-09_06:06:44.539176) 06:06:45.780555 run osmo-msc_10.42.42.6(pid=32642): stderr: | 20221209060644862 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060644863 DLGLOBAL DEBUG validating counter group 0x7fc41c4ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060644863 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060644863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060644863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060644863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060644865 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060644865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060644865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060644866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:45.832778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32635): Terminating (SIGTERM) 06:06:45.881287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32638): Terminating (SIGTERM) 06:06:45.938893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32641): Terminating (SIGTERM) 06:06:45.981402 --- ParallelTerminationStrategy: PID 32635 died... 06:06:46.001437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32635): Terminated: ok {rc=0} 06:06:46.049154 --- ParallelTerminationStrategy: PID 32638 died... 06:06:46.069429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32638): Terminated: ok {rc=0} 06:06:46.116119 --- ParallelTerminationStrategy: PID 32641 died... 06:06:46.136502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32641): Terminated: ok {rc=0} 06:06:46.225340 bus /sierra_3: Setting Powered False 06:06:47.326954 bus /sierra_3: Setting Powered False 06:06:48.443289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:06:49.687339 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:06:49.693309 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:06:49.726794 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:06:49.753323 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:06:49.804239 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:06:49.836230 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:06:49.862492 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:06:50.414149 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:06:50.462624 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:50.473908 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:06:50.524490 tst mo_mt_call.py: using LAC 19454 06:06:50.643128 tst mo_mt_call.py: using RAC 74 06:06:50.763024 tst mo_mt_call.py: using CellId 19454 06:06:50.881426 tst mo_mt_call.py: using BVCI 19455 06:06:50.990225 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:51.001566 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:51.012579 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:51.023832 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:51.035147 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:06:51.046393 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:51.166915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:06:51.284252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:06:51.784487 run create_hlr_db(pid=32647): Launched 06:06:51.915431 bus /sierra_2: Setting Powered False 06:06:52.978569 run create_hlr_db(pid=32647): Terminated: ok {rc=0} 06:06:53.425878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Launched 06:06:53.745335 run osmo-hlr_10.42.42.2(pid=32650): Launched 06:06:53.868473 run osmo-stp_10.42.42.5: Starting osmo-stp 06:06:54.420856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Launched 06:06:54.741161 run osmo-stp_10.42.42.5(pid=32653): Launched 06:06:54.863521 run osmo-msc_10.42.42.6: Starting osmo-msc 06:06:55.446104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Launched 06:06:55.768002 run osmo-msc_10.42.42.6(pid=32656): Launched 06:06:55.947924 run osmo-stp_10.42.42.5(pid=32653): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] 06:06:56.085316 run osmo-stp_10.42.42.5(pid=32653): stdout: | (launched: 2022-12-09_06:06:54.683103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:56.222079 run osmo-stp_10.42.42.5(pid=32653): stderr: | 20221209060654874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060654874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060654874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060654875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060654875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060654875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060654875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:56.357850 run osmo-stp_10.42.42.5(pid=32653): stdout: | (launched: 2022-12-09_06:06:54.683103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:06:56.485498 run osmo-stp_10.42.42.5(pid=32653): stderr: | 20221209060654874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060654874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060654874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060654875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060654875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060654875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060654875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:06:56.638876 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32653): Process ended prematurely: osmo-stp_10.42.42.5(pid=32653) [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:06:56.648153 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:06:56.675899 run osmo-hlr_10.42.42.2(pid=32650): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32650)] 06:06:56.725948 run osmo-hlr_10.42.42.2(pid=32650): stdout: | (launched: 2022-12-09_06:06:53.687487) 06:06:56.777660 run osmo-hlr_10.42.42.2(pid=32650): stderr: | 20221209060653886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060653886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060653886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060653886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060653887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060653887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060653899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060653907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060653907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060653907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:06:56.850168 run osmo-msc_10.42.42.6(pid=32656): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32656)] 06:06:56.900173 run osmo-msc_10.42.42.6(pid=32656): stdout: | (launched: 2022-12-09_06:06:55.709259) 06:06:56.951928 run osmo-msc_10.42.42.6(pid=32656): stderr: | 20221209060656033 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060656033 DLGLOBAL DEBUG validating counter group 0x7f922f89dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060656033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060656033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060656034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060656034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060656035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060656036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060656036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060656036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:06:57.003891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Terminating (SIGTERM) 06:06:57.045728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Terminating (SIGTERM) 06:06:57.087656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Terminating (SIGTERM) 06:06:57.129788 --- ParallelTerminationStrategy: PID 32649 died... 06:06:57.150061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32649): Terminated: ok {rc=0} 06:06:57.196701 --- ParallelTerminationStrategy: PID 32652 died... 06:06:57.216302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32652): Terminated: ok {rc=0} 06:06:57.262590 --- ParallelTerminationStrategy: PID 32655 died... 06:06:57.282194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32655): Terminated: ok {rc=0} 06:06:57.370300 bus /sierra_3: Setting Powered False 06:06:58.468680 bus /sierra_3: Setting Powered False 06:06:59.585997 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:07:00.730626 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:00.742493 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:07:00.793371 tst mo_mt_call_osmux.py: using LAC 19455 06:07:00.929114 tst mo_mt_call_osmux.py: using RAC 75 06:07:01.049529 tst mo_mt_call_osmux.py: using CellId 19455 06:07:01.183776 tst mo_mt_call_osmux.py: using BVCI 19456 06:07:01.299121 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:01.311689 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:01.323969 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:01.336925 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:01.351204 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:07:01.364843 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:01.482347 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:07:01.602400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:02.135459 run create_hlr_db(pid=32658): Launched 06:07:02.286993 bus /sierra_2: Setting Powered False 06:07:03.346869 run create_hlr_db(pid=32658): Terminated: ok {rc=0} 06:07:03.766181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Launched 06:07:04.066022 run osmo-hlr_10.42.42.2(pid=32661): Launched 06:07:04.180599 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:04.701473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Launched 06:07:05.002164 run osmo-stp_10.42.42.5(pid=32664): Launched 06:07:05.116103 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:05.660129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Launched 06:07:05.961542 run osmo-msc_10.42.42.6(pid=32667): Launched 06:07:06.130109 run osmo-stp_10.42.42.5(pid=32664): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] 06:07:06.259182 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-09_06:07:04.947036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:06.387167 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221209060705116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060705117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060705117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060705117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060705118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060705118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060705118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:06.512757 run osmo-stp_10.42.42.5(pid=32664): stdout: | (launched: 2022-12-09_06:07:04.947036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:06.632030 run osmo-stp_10.42.42.5(pid=32664): stderr: | 20221209060705116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060705117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060705117 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060705117 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060705118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060705118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060705118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:06.775075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:07:06.783828 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:07:06.810430 run osmo-hlr_10.42.42.2(pid=32661): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32661)] 06:07:06.859030 run osmo-hlr_10.42.42.2(pid=32661): stdout: | (launched: 2022-12-09_06:07:04.011241) 06:07:06.909137 run osmo-hlr_10.42.42.2(pid=32661): stderr: | 20221209060704186 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060704186 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060704186 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060704186 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060704186 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060704186 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060704198 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060704207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060704207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060704207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:06.979077 run osmo-msc_10.42.42.6(pid=32667): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32667)] 06:07:07.027349 run osmo-msc_10.42.42.6(pid=32667): stdout: | (launched: 2022-12-09_06:07:05.906478) 06:07:07.077138 run osmo-msc_10.42.42.6(pid=32667): stderr: | 20221209060706181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060706181 DLGLOBAL DEBUG validating counter group 0x7fa33a103c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060706181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060706181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060706181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060706182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060706184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060706184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060706184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060706184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:07.127515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Terminating (SIGTERM) 06:07:07.167472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Terminating (SIGTERM) 06:07:07.207747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Terminating (SIGTERM) 06:07:07.248061 --- ParallelTerminationStrategy: PID 32660 died... 06:07:07.267320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32660): Terminated: ok {rc=0} 06:07:07.312059 --- ParallelTerminationStrategy: PID 32663 died... 06:07:07.330755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32663): Terminated: ok {rc=0} 06:07:07.375668 --- ParallelTerminationStrategy: PID 32666 died... 06:07:07.394513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32666): Terminated: ok {rc=0} 06:07:07.480838 bus /sierra_3: Setting Powered False 06:07:08.580820 bus /sierra_3: Setting Powered False 06:07:09.697766 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:trx-umtrx --------------------------------------------------------------------- 06:07:10.952509 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:10.957413 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:07:10.991208 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:07:11.018635 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:07:11.103542 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:07:11.136786 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:07:11.164473 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:07:11.746742 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 06:07:11.752635 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:11.764081 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:11.811630 tst emergency_mo_mt_call.py: using LAC 19456 06:07:11.925366 tst emergency_mo_mt_call.py: using RAC 76 06:07:12.039543 tst emergency_mo_mt_call.py: using CellId 19456 06:07:12.165115 tst emergency_mo_mt_call.py: using BVCI 19457 06:07:12.280005 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:12.291232 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:12.302351 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:12.313253 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:12.324219 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:12.335238 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:12.452898 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:12.573572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:13.065228 run create_hlr_db(pid=32673): Launched 06:07:13.194229 bus /sierra_2: Setting Powered False 06:07:14.257562 run create_hlr_db(pid=32673): Terminated: ok {rc=0} 06:07:14.681259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32675): Launched 06:07:14.976032 run osmo-hlr_10.42.42.2(pid=32676): Launched 06:07:15.087761 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:15.609632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32678): Launched 06:07:15.921711 run osmo-stp_10.42.42.5(pid=32679): Launched 06:07:16.148512 tst emergency_mo_mt_call.py: using MSISDN 7055 06:07:16.314373 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:16.894501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32681): Launched 06:07:17.230747 run osmo-msc_10.42.42.6(pid=32682): Launched 06:07:17.475523 run osmo-stp_10.42.42.5(pid=32679): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32679)] 06:07:17.612111 run osmo-stp_10.42.42.5(pid=32679): stdout: | (launched: 2022-12-09_06:07:15.852245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:17.747574 run osmo-stp_10.42.42.5(pid=32679): stderr: | 20221209060716157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060716157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060716158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060716158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060716158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060716158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060716159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:17.881123 run osmo-stp_10.42.42.5(pid=32679): stdout: | (launched: 2022-12-09_06:07:15.852245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:18.007864 run osmo-stp_10.42.42.5(pid=32679): stderr: | 20221209060716157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060716157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060716158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060716158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060716158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060716158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060716159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:18.159435 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32679): Process ended prematurely: osmo-stp_10.42.42.5(pid=32679) [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32679)] [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 06:07:18.168360 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 06:07:18.195893 run osmo-hlr_10.42.42.2(pid=32676): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32676)] 06:07:18.246233 run osmo-hlr_10.42.42.2(pid=32676): stdout: | (launched: 2022-12-09_06:07:14.922520) 06:07:18.298181 run osmo-hlr_10.42.42.2(pid=32676): stderr: | 20221209060715097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060715097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060715097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060715097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060715097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060715097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060715111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060715121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060715121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060715121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:18.370801 run osmo-msc_10.42.42.6(pid=32682): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32682)] 06:07:18.421192 run osmo-msc_10.42.42.6(pid=32682): stdout: | (launched: 2022-12-09_06:07:17.168682) 06:07:18.472914 run osmo-msc_10.42.42.6(pid=32682): stderr: | 20221209060717542 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060717542 DLGLOBAL DEBUG validating counter group 0x7fac7696cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060717542 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060717542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060717542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060717543 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060717544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060717545 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060717545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060717545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:18.525170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32675): Terminating (SIGTERM) 06:07:18.567056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32678): Terminating (SIGTERM) 06:07:18.609120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32681): Terminating (SIGTERM) 06:07:18.651301 --- ParallelTerminationStrategy: PID 32675 died... 06:07:18.671167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32675): Terminated: ok {rc=0} 06:07:18.717675 --- ParallelTerminationStrategy: PID 32678 died... 06:07:18.737434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32678): Terminated: ok {rc=0} 06:07:18.783567 --- ParallelTerminationStrategy: PID 32681 died... 06:07:18.803095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32681): Terminated: ok {rc=0} 06:07:18.890657 bus /sierra_3: Setting Powered False 06:07:19.989903 bus /sierra_3: Setting Powered False 06:07:21.104689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 06:07:22.189681 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.201419 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:22.253235 tst emergency_preemptive_call.py: using LAC 19457 06:07:22.378508 tst emergency_preemptive_call.py: using RAC 77 06:07:22.502162 tst emergency_preemptive_call.py: using CellId 19457 06:07:22.627606 tst emergency_preemptive_call.py: using BVCI 19458 06:07:22.735865 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.746507 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.756892 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.767595 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.778189 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 06:07:22.788749 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:22.903151 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:23.019986 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:23.138361 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:23.252494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:23.710517 run create_hlr_db(pid=32684): Launched 06:07:23.823468 bus /sierra_2: Setting Powered False 06:07:24.883614 run create_hlr_db(pid=32684): Terminated: ok {rc=0} 06:07:25.318217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Launched 06:07:25.634378 run osmo-hlr_10.42.42.2(pid=32687): Launched 06:07:25.754291 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:26.300787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Launched 06:07:26.616756 run osmo-stp_10.42.42.5(pid=32690): Launched 06:07:26.750358 tst emergency_preemptive_call.py: using MSISDN 7056 06:07:26.913188 run osmo-msc_10.42.42.6: Starting osmo-msc 06:07:27.480341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32692): Launched 06:07:27.795405 run osmo-msc_10.42.42.6(pid=32693): Launched 06:07:27.970428 run osmo-stp_10.42.42.5(pid=32690): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] 06:07:28.109507 run osmo-stp_10.42.42.5(pid=32690): stdout: | (launched: 2022-12-09_06:07:26.559224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:28.244229 run osmo-stp_10.42.42.5(pid=32690): stderr: | 20221209060726751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060726751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060726751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060726752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060726754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060726754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060726754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:28.378106 run osmo-stp_10.42.42.5(pid=32690): stdout: | (launched: 2022-12-09_06:07:26.559224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:28.504081 run osmo-stp_10.42.42.5(pid=32690): stderr: | 20221209060726751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060726751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060726751 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060726752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060726754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060726754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060726754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:28.655643 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32690): Process ended prematurely: osmo-stp_10.42.42.5(pid=32690) [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 06:07:28.664427 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 06:07:28.691712 run osmo-hlr_10.42.42.2(pid=32687): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32687)] 06:07:28.741653 run osmo-hlr_10.42.42.2(pid=32687): stdout: | (launched: 2022-12-09_06:07:25.577257) 06:07:28.793374 run osmo-hlr_10.42.42.2(pid=32687): stderr: | 20221209060725775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060725775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060725776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060725776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060725776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060725776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060725788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060725796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060725796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060725797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:28.865712 run osmo-msc_10.42.42.6(pid=32693): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32693)] 06:07:28.915633 run osmo-msc_10.42.42.6(pid=32693): stdout: | (launched: 2022-12-09_06:07:27.738004) 06:07:28.967526 run osmo-msc_10.42.42.6(pid=32693): stderr: | 20221209060728061 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209060728061 DLGLOBAL DEBUG validating counter group 0x7f37b569fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209060728061 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209060728061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209060728062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209060728062 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209060728064 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209060728064 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209060728064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209060728064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:07:29.019431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Terminating (SIGTERM) 06:07:29.061191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Terminating (SIGTERM) 06:07:29.103119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32692): Terminating (SIGTERM) 06:07:29.145195 --- ParallelTerminationStrategy: PID 32686 died... 06:07:29.165502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32686): Terminated: ok {rc=0} 06:07:29.211664 --- ParallelTerminationStrategy: PID 32689 died... 06:07:29.231292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32689): Terminated: ok {rc=0} 06:07:29.277309 --- ParallelTerminationStrategy: PID 32692 died... 06:07:29.297092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32692): Terminated: ok {rc=0} 06:07:29.383857 bus /sierra_9: Setting Powered False 06:07:30.483240 bus /sierra_9: Setting Powered False 06:07:31.605372 bus /sierra_8: Setting Powered False 06:07:32.705924 bus /sierra_8: Setting Powered False 06:07:33.819425 bus /sierra_3: Setting Powered False 06:07:34.914076 bus /sierra_3: Setting Powered False 06:07:36.028600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx --------------------------------------------------------------------- 06:07:37.309888 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:07:37.314444 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 06:07:37.347185 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 06:07:37.386143 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 06:07:37.474526 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 06:07:37.507628 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 06:07:37.546922 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 06:07:38.138286 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 06:07:38.191156 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.202180 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:38.253791 tst cs_paging_gprs_active.py: using LAC 19458 06:07:38.380360 tst cs_paging_gprs_active.py: using RAC 78 06:07:38.505505 tst cs_paging_gprs_active.py: using CellId 19458 06:07:38.630711 tst cs_paging_gprs_active.py: using BVCI 19459 06:07:38.748123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.759166 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.769967 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.780760 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.791487 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.803631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.814538 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.825288 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:38.836139 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:38.952530 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:39.073461 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:07:39.294127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:39.618151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32700): Launched 06:07:39.898974 run iperf3-srv_10.42.42.10(pid=32701): Launched 06:07:40.020584 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:07:40.240050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:40.565035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32702): Launched 06:07:40.846195 run iperf3-srv_10.42.42.10(pid=32703): Launched 06:07:40.967520 tst cs_paging_gprs_active.py:38: start network... 06:07:41.185504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:41.687702 run create_hlr_db(pid=32704): Launched 06:07:41.820080 bus /sierra_2: Setting Powered False 06:07:42.884757 run create_hlr_db(pid=32704): Terminated: ok {rc=0} 06:07:43.317216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32706): Launched 06:07:43.619575 run osmo-hlr_10.42.42.2(pid=32707): Launched 06:07:43.736150 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:44.268777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32709): Launched 06:07:44.594113 run osmo-stp_10.42.42.5(pid=32710): Launched 06:07:44.718080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:45.276642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32712): Launched 06:07:45.399485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:45.671242 run patchelf(pid=32713): Launched 06:07:45.853332 run osmo-stp_10.42.42.5(pid=32710): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32710)] 06:07:46.011528 run osmo-stp_10.42.42.5(pid=32710): stdout: | (launched: 2022-12-09_06:07:44.535338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:46.153125 run osmo-stp_10.42.42.5(pid=32710): stderr: | 20221209060744728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060744728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060744728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060744728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060744729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060744729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060744729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:46.296188 run osmo-stp_10.42.42.5(pid=32710): stdout: | (launched: 2022-12-09_06:07:44.535338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:46.432188 run osmo-stp_10.42.42.5(pid=32710): stderr: | 20221209060744728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060744728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060744728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060744728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060744729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060744729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060744729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:46.625743 run patchelf(pid=32713): Terminating (SIGINT) 06:07:46.838871 run patchelf(pid=32713): Terminated: ok {rc=0} 06:07:46.973093 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32710): Process ended prematurely: osmo-stp_10.42.42.5(pid=32710) [trial-2355↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32710)] [trial-2355↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 06:07:46.983689 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:07:47.013227 run osmo-hlr_10.42.42.2(pid=32707): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32707)] 06:07:47.064576 run osmo-hlr_10.42.42.2(pid=32707): stdout: | (launched: 2022-12-09_06:07:43.564232) 06:07:47.117968 run osmo-hlr_10.42.42.2(pid=32707): stderr: | 20221209060743741 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060743741 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060743741 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060743741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060743741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060743741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060743753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060743762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060743762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060743762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:47.171458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32700): Terminating (SIGTERM) 06:07:47.215204 run iperf3-srv_10.42.42.10(pid=32701): Terminating (SIGTERM) 06:07:47.258123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32702): Terminating (SIGTERM) 06:07:47.300210 run iperf3-srv_10.42.42.10(pid=32703): Terminating (SIGTERM) 06:07:47.342271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32706): Terminating (SIGTERM) 06:07:47.384221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32709): Terminating (SIGTERM) 06:07:47.426264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32712): Terminating (SIGTERM) 06:07:47.468426 --- ParallelTerminationStrategy: PID 32700 died... 06:07:47.488577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32700): Terminated: ok {rc=0} 06:07:47.535025 --- ParallelTerminationStrategy: PID 32701 died... 06:07:47.554646 run iperf3-srv_10.42.42.10(pid=32701): Terminated {rc=256} 06:07:47.600433 --- ParallelTerminationStrategy: PID 32702 died... 06:07:47.620039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32702): Terminated: ok {rc=0} 06:07:47.666493 --- ParallelTerminationStrategy: PID 32703 died... 06:07:47.686136 run iperf3-srv_10.42.42.10(pid=32703): Terminated {rc=256} 06:07:47.732010 --- ParallelTerminationStrategy: PID 32706 died... 06:07:47.751522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32706): Terminated: ok {rc=0} 06:07:47.797656 --- ParallelTerminationStrategy: PID 32709 died... 06:07:47.817369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32709): Terminated: ok {rc=0} 06:07:47.863413 --- ParallelTerminationStrategy: PID 32712 died... 06:07:47.882971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32712): Terminated: ok {rc=0} 06:07:47.970612 bus /gobi_0: Setting Powered False 06:07:49.068452 bus /gobi_0: Setting Powered False 06:07:50.185888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx iperf3.py ---------------------------------------------- 06:07:51.337483 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.349043 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:07:51.404071 tst iperf3.py: using LAC 19459 06:07:51.530794 tst iperf3.py: using RAC 79 06:07:51.657638 tst iperf3.py: using CellId 19459 06:07:51.783894 tst iperf3.py: using BVCI 19460 06:07:51.901817 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.913001 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.923863 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.934733 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.945529 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.956210 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.967167 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.977983 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:07:51.988846 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:07:52.103070 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:07:52.305936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:07:52.606834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Launched 06:07:52.868388 run iperf3-srv_10.42.42.10(pid=32715): Launched 06:07:52.981278 tst iperf3.py:8: start network... 06:07:53.183049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:07:53.649224 run create_hlr_db(pid=32716): Launched 06:07:53.765204 bus /gobi_6: Setting Powered False 06:07:54.825701 run create_hlr_db(pid=32716): Terminated: ok {rc=0} 06:07:55.268451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32718): Launched 06:07:55.591601 run osmo-hlr_10.42.42.2(pid=32719): Launched 06:07:55.715355 run osmo-stp_10.42.42.5: Starting osmo-stp 06:07:56.273436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32721): Launched 06:07:56.595246 run osmo-stp_10.42.42.5(pid=32722): Launched 06:07:56.717942 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:07:57.273896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32724): Launched 06:07:57.397061 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:07:57.669658 run patchelf(pid=32725): Launched 06:07:57.848901 run osmo-stp_10.42.42.5(pid=32722): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32722)] 06:07:57.986464 run osmo-stp_10.42.42.5(pid=32722): stdout: | (launched: 2022-12-09_06:07:56.536615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:58.125375 run osmo-stp_10.42.42.5(pid=32722): stderr: | 20221209060756728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060756728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060756729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060756729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060756730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060756730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060756730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:58.264632 run osmo-stp_10.42.42.5(pid=32722): stdout: | (launched: 2022-12-09_06:07:56.536615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:07:58.399021 run osmo-stp_10.42.42.5(pid=32722): stderr: | 20221209060756728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060756728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060756729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060756729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060756730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060756730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060756730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:07:58.557362 run patchelf(pid=32725): Terminating (SIGINT) 06:07:58.738857 run patchelf(pid=32725): Terminated: ok {rc=0} 06:07:58.869303 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32722): Process ended prematurely: osmo-stp_10.42.42.5(pid=32722) [trial-2355↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32722)] [trial-2355↪gprs:trx-umtrx↪iperf3.py:8] 06:07:58.879200 tst iperf3.py:8: Test FAILED (7.6 sec) 06:07:58.907643 run osmo-hlr_10.42.42.2(pid=32719): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32719)] 06:07:58.957796 run osmo-hlr_10.42.42.2(pid=32719): stdout: | (launched: 2022-12-09_06:07:55.532878) 06:07:59.009573 run osmo-hlr_10.42.42.2(pid=32719): stderr: | 20221209060755730 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060755730 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060755731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060755731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060755731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060755731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060755744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060755752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060755752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060755752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:07:59.061845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Terminating (SIGTERM) 06:07:59.103970 run iperf3-srv_10.42.42.10(pid=32715): Terminating (SIGTERM) 06:07:59.145997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32718): Terminating (SIGTERM) 06:07:59.188488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32721): Terminating (SIGTERM) 06:07:59.230760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32724): Terminating (SIGTERM) 06:07:59.273922 --- ParallelTerminationStrategy: PID 32714 died... 06:07:59.295461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32714): Terminated: ok {rc=0} 06:07:59.341668 --- ParallelTerminationStrategy: PID 32715 died... 06:07:59.360158 run iperf3-srv_10.42.42.10(pid=32715): Terminated {rc=256} 06:07:59.405935 --- ParallelTerminationStrategy: PID 32718 died... 06:07:59.424642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32718): Terminated: ok {rc=0} 06:07:59.470255 --- ParallelTerminationStrategy: PID 32721 died... 06:07:59.489008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32721): Terminated: ok {rc=0} 06:07:59.534785 --- ParallelTerminationStrategy: PID 32724 died... 06:07:59.553517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32724): Terminated: ok {rc=0} 06:07:59.639711 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 06:08:00.792519 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:00.804256 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:00.860329 tst iperf3m4.py: using LAC 19460 06:08:00.991648 tst iperf3m4.py: using RAC 80 06:08:01.145269 tst iperf3m4.py: using CellId 19460 06:08:01.311538 tst iperf3m4.py: using BVCI 19461 06:08:01.448463 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.462240 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.476792 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.489704 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.504907 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.517835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.530960 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.543576 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:01.555442 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:01.694763 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:01.835833 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:01.973875 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:02.117643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:02.343200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:02.729776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=307): Launched 06:08:03.077687 run iperf3-srv_10.42.42.10(pid=323): Launched 06:08:03.264573 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:08:03.519641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:03.916630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Launched 06:08:04.297048 run iperf3-srv_10.42.42.10(pid=465): Launched 06:08:04.463830 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:08:04.731107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:05.096521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=544): Launched 06:08:05.413057 run iperf3-srv_10.42.42.10(pid=545): Launched 06:08:05.538871 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:08:05.750378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:06.068329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=546): Launched 06:08:06.361860 run iperf3-srv_10.42.42.10(pid=547): Launched 06:08:06.493537 tst iperf3m4.py:8: start network... 06:08:06.701710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:07.188919 run create_hlr_db(pid=550): Launched 06:08:07.337873 bus /gobi_6: Setting Powered False 06:08:08.403691 run create_hlr_db(pid=550): Terminated: ok {rc=0} 06:08:08.868076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Launched 06:08:09.215634 run osmo-hlr_10.42.42.2(pid=553): Launched 06:08:09.466469 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:10.143761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Launched 06:08:10.495159 run osmo-stp_10.42.42.5(pid=556): Launched 06:08:10.750751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:11.405845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Launched 06:08:11.545942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:11.831113 run patchelf(pid=559): Launched 06:08:12.033234 run osmo-stp_10.42.42.5(pid=556): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] 06:08:12.177583 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-09_06:08:10.432109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:12.323778 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221209060810730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060810730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060810730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060810731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060810731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060810731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060810732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:12.468930 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-09_06:08:10.432109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:12.610140 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221209060810730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060810730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060810730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060810731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060810731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060810731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060810732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:12.776692 run patchelf(pid=559): Terminating (SIGINT) 06:08:12.966256 run patchelf(pid=559): Terminated: ok {rc=0} 06:08:13.105150 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2355↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] [trial-2355↪gprs:trx-umtrx↪iperf3m4.py:8] 06:08:13.116590 tst iperf3m4.py:8: Test FAILED (12.4 sec) 06:08:13.147173 run osmo-hlr_10.42.42.2(pid=553): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=553)] 06:08:13.201181 run osmo-hlr_10.42.42.2(pid=553): stdout: | (launched: 2022-12-09_06:08:09.151754) 06:08:13.255566 run osmo-hlr_10.42.42.2(pid=553): stderr: | 20221209060809456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060809456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060809456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060809456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060809456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060809456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060809474 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060809486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060809486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060809486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:13.311201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=307): Terminating (SIGTERM) 06:08:13.355802 run iperf3-srv_10.42.42.10(pid=323): Terminating (SIGTERM) 06:08:13.402778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Terminating (SIGTERM) 06:08:13.447313 run iperf3-srv_10.42.42.10(pid=465): Terminating (SIGTERM) 06:08:13.494431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=544): Terminating (SIGTERM) 06:08:13.540506 run iperf3-srv_10.42.42.10(pid=545): Terminating (SIGTERM) 06:08:13.586290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=546): Terminating (SIGTERM) 06:08:13.629905 run iperf3-srv_10.42.42.10(pid=547): Terminating (SIGTERM) 06:08:13.675456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminating (SIGTERM) 06:08:13.720921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminating (SIGTERM) 06:08:13.767716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Terminating (SIGTERM) 06:08:13.814516 --- ParallelTerminationStrategy: PID 307 died... 06:08:13.835909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=307): Terminated: ok {rc=0} 06:08:13.886942 --- ParallelTerminationStrategy: PID 323 died... 06:08:13.908805 run iperf3-srv_10.42.42.10(pid=323): Terminated {rc=256} 06:08:13.958334 --- ParallelTerminationStrategy: PID 418 died... 06:08:13.979402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=418): Terminated: ok {rc=0} 06:08:14.030608 --- ParallelTerminationStrategy: PID 465 died... 06:08:14.051806 run iperf3-srv_10.42.42.10(pid=465): Terminated {rc=256} 06:08:14.101589 --- ParallelTerminationStrategy: PID 544 died... 06:08:14.123553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=544): Terminated: ok {rc=0} 06:08:14.172796 --- ParallelTerminationStrategy: PID 545 died... 06:08:14.193963 run iperf3-srv_10.42.42.10(pid=545): Terminated {rc=256} 06:08:14.243345 --- ParallelTerminationStrategy: PID 546 died... 06:08:14.264262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=546): Terminated: ok {rc=0} 06:08:14.314839 --- ParallelTerminationStrategy: PID 547 died... 06:08:14.336107 run iperf3-srv_10.42.42.10(pid=547): Terminated {rc=256} 06:08:14.386060 --- ParallelTerminationStrategy: PID 552 died... 06:08:14.407059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminated: ok {rc=0} 06:08:14.457198 --- ParallelTerminationStrategy: PID 555 died... 06:08:14.478322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminated: ok {rc=0} 06:08:14.529803 --- ParallelTerminationStrategy: PID 558 died... 06:08:14.550766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=558): Terminated: ok {rc=0} 06:08:14.648288 bus /gobi_4: Setting Powered False 06:08:15.753607 bus /gobi_4: Setting Powered False 06:08:16.904862 bus /gobi_1: Setting Powered False 06:08:18.048405 bus /gobi_1: Setting Powered False 06:08:19.172791 bus /gobi_0: Setting Powered False 06:08:20.279028 bus /gobi_0: Setting Powered False 06:08:21.403686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx ping.py ---------------------------------------------- 06:08:22.515299 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:22.528519 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:22.581540 tst ping.py: using LAC 19461 06:08:22.704189 tst ping.py: using RAC 81 06:08:22.824449 tst ping.py: using CellId 19461 06:08:22.949496 tst ping.py: using BVCI 19462 06:08:23.064471 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.076393 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.088250 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.100621 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.113490 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.126139 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.138429 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:23.150859 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:23.271597 tst ping.py:19: start network... 06:08:23.496111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:24.012676 run create_hlr_db(pid=560): Launched 06:08:24.177853 bus /gobi_6: Setting Powered False 06:08:25.242156 run create_hlr_db(pid=560): Terminated: ok {rc=0} 06:08:25.690938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=564): Launched 06:08:26.013467 run osmo-hlr_10.42.42.2(pid=565): Launched 06:08:26.135465 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:26.695695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=567): Launched 06:08:27.018390 run osmo-stp_10.42.42.5(pid=568): Launched 06:08:27.142524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:27.698968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=570): Launched 06:08:27.823844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:28.096679 run patchelf(pid=571): Launched 06:08:28.277562 run osmo-stp_10.42.42.5(pid=568): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=568)] 06:08:28.414975 run osmo-stp_10.42.42.5(pid=568): stdout: | (launched: 2022-12-09_06:08:26.959826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:28.554112 run osmo-stp_10.42.42.5(pid=568): stderr: | 20221209060827153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060827153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060827153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060827154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060827154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060827154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060827154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:28.692886 run osmo-stp_10.42.42.5(pid=568): stdout: | (launched: 2022-12-09_06:08:26.959826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:28.825783 run osmo-stp_10.42.42.5(pid=568): stderr: | 20221209060827153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060827153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060827153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060827154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060827154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060827154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060827154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:28.982522 run patchelf(pid=571): Terminating (SIGINT) 06:08:29.163797 run patchelf(pid=571): Terminated: ok {rc=0} 06:08:29.294640 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=568): Process ended prematurely: osmo-stp_10.42.42.5(pid=568) [trial-2355↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=568)] [trial-2355↪gprs:trx-umtrx↪ping.py:22] 06:08:29.304169 tst ping.py:22: Test FAILED (6.8 sec) 06:08:29.332608 run osmo-hlr_10.42.42.2(pid=565): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=565)] 06:08:29.383012 run osmo-hlr_10.42.42.2(pid=565): stdout: | (launched: 2022-12-09_06:08:25.955048) 06:08:29.435169 run osmo-hlr_10.42.42.2(pid=565): stderr: | 20221209060826156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060826156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060826156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060826156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060826156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060826156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060826170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060826178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060826179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060826179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:29.487704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=564): Terminating (SIGTERM) 06:08:29.530074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=567): Terminating (SIGTERM) 06:08:29.572577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=570): Terminating (SIGTERM) 06:08:29.615697 --- ParallelTerminationStrategy: PID 564 died... 06:08:29.635942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=564): Terminated: ok {rc=0} 06:08:29.682996 --- ParallelTerminationStrategy: PID 567 died... 06:08:29.702891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=567): Terminated: ok {rc=0} 06:08:29.749451 --- ParallelTerminationStrategy: PID 570 died... 06:08:29.769373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=570): Terminated: ok {rc=0} 06:08:29.858033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 06:08:30.958578 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:30.978723 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 06:08:31.033529 tst ping_idle_ping.py: using LAC 19462 06:08:31.161861 tst ping_idle_ping.py: using RAC 82 06:08:31.282593 tst ping_idle_ping.py: using CellId 19462 06:08:31.411298 tst ping_idle_ping.py: using BVCI 19463 06:08:31.531326 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.543079 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.554835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.567097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.579046 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.590946 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.603134 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 06:08:31.615275 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 06:08:31.737407 tst ping_idle_ping.py:24: start network... 06:08:31.990176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:32.497902 run create_hlr_db(pid=572): Launched 06:08:32.629927 bus /gobi_6: Setting Powered False 06:08:33.693701 run create_hlr_db(pid=572): Terminated: ok {rc=0} 06:08:34.143965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Launched 06:08:34.468142 run osmo-hlr_10.42.42.2(pid=575): Launched 06:08:34.591588 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:35.153208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Launched 06:08:35.478383 run osmo-stp_10.42.42.5(pid=578): Launched 06:08:35.601961 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:36.159004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=580): Launched 06:08:36.284833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:36.558157 run patchelf(pid=581): Launched 06:08:36.740475 run osmo-stp_10.42.42.5(pid=578): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] 06:08:36.878102 run osmo-stp_10.42.42.5(pid=578): stdout: | (launched: 2022-12-09_06:08:35.419448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:37.016810 run osmo-stp_10.42.42.5(pid=578): stderr: | 20221209060835613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060835613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060835613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060835613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060835616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060835616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060835616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:37.155624 run osmo-stp_10.42.42.5(pid=578): stdout: | (launched: 2022-12-09_06:08:35.419448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:37.288571 run osmo-stp_10.42.42.5(pid=578): stderr: | 20221209060835613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060835613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060835613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060835613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060835616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060835616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060835616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:37.445705 run patchelf(pid=581): Terminating (SIGINT) 06:08:37.627070 run patchelf(pid=581): Terminated: ok {rc=0} 06:08:37.757780 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=578): Process ended prematurely: osmo-stp_10.42.42.5(pid=578) [trial-2355↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] [trial-2355↪gprs:trx-umtrx↪ping_idle_ping.py:27] 06:08:37.767281 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 06:08:37.795500 run osmo-hlr_10.42.42.2(pid=575): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=575)] 06:08:37.846326 run osmo-hlr_10.42.42.2(pid=575): stdout: | (launched: 2022-12-09_06:08:34.409238) 06:08:37.898824 run osmo-hlr_10.42.42.2(pid=575): stderr: | 20221209060834609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060834609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060834609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060834609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060834609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060834609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060834621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060834630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060834630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060834630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:37.951874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Terminating (SIGTERM) 06:08:37.994512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Terminating (SIGTERM) 06:08:38.037140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=580): Terminating (SIGTERM) 06:08:38.080213 --- ParallelTerminationStrategy: PID 574 died... 06:08:38.100533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=574): Terminated: ok {rc=0} 06:08:38.147891 --- ParallelTerminationStrategy: PID 577 died... 06:08:38.167907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=577): Terminated: ok {rc=0} 06:08:38.215004 --- ParallelTerminationStrategy: PID 580 died... 06:08:38.235041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=580): Terminated: ok {rc=0} 06:08:38.323969 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 06:08:39.633430 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:08:39.639617 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:08:39.673405 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:08:39.713069 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:08:39.800483 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:08:39.834140 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:08:39.873880 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:08:40.464914 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:08:40.515178 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:40.526351 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:40.575231 tst cs_paging_gprs_active.py: using LAC 19463 06:08:40.696726 tst cs_paging_gprs_active.py: using RAC 83 06:08:40.815995 tst cs_paging_gprs_active.py: using CellId 19463 06:08:40.935401 tst cs_paging_gprs_active.py: using BVCI 19464 06:08:41.047633 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.058769 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.069705 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.080453 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.091752 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.102523 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.114000 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.124934 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:41.136223 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:41.254138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:41.375143 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:08:41.597838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:41.928872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=586): Launched 06:08:42.214990 run iperf3-srv_10.42.42.10(pid=587): Launched 06:08:42.340098 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:08:42.561670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:42.892444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=588): Launched 06:08:43.179393 run iperf3-srv_10.42.42.10(pid=589): Launched 06:08:43.304509 tst cs_paging_gprs_active.py:38: start network... 06:08:43.526866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:44.037954 run create_hlr_db(pid=590): Launched 06:08:44.173731 bus /gobi_6: Setting Powered False 06:08:45.239654 run create_hlr_db(pid=590): Terminated: ok {rc=0} 06:08:45.699427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=592): Launched 06:08:46.037674 run osmo-hlr_10.42.42.2(pid=593): Launched 06:08:46.331918 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:46.956577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=595): Launched 06:08:47.300006 run osmo-stp_10.42.42.5(pid=596): Launched 06:08:47.426048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:08:47.993647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=598): Launched 06:08:48.119285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:08:48.397876 run patchelf(pid=599): Launched 06:08:48.580369 run osmo-stp_10.42.42.5(pid=596): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=596)] 06:08:48.719877 run osmo-stp_10.42.42.5(pid=596): stdout: | (launched: 2022-12-09_06:08:47.239836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:48.860519 run osmo-stp_10.42.42.5(pid=596): stderr: | 20221209060847433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060847433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060847433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060847434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060847434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060847434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060847435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:49.000934 run osmo-stp_10.42.42.5(pid=596): stdout: | (launched: 2022-12-09_06:08:47.239836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:08:49.135687 run osmo-stp_10.42.42.5(pid=596): stderr: | 20221209060847433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060847433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060847433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060847434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060847434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060847434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060847435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:08:49.295768 run patchelf(pid=599): Terminating (SIGINT) 06:08:49.479890 run patchelf(pid=599): Terminated: ok {rc=0} 06:08:49.612756 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=596): Process ended prematurely: osmo-stp_10.42.42.5(pid=596) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=596)] [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:08:49.622792 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 06:08:49.651584 run osmo-hlr_10.42.42.2(pid=593): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=593)] 06:08:49.702436 run osmo-hlr_10.42.42.2(pid=593): stdout: | (launched: 2022-12-09_06:08:45.973611) 06:08:49.755173 run osmo-hlr_10.42.42.2(pid=593): stderr: | 20221209060846216 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060846216 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060846216 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060846216 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060846216 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060846216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060846235 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060846243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060846243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060846243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:08:49.808094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=586): Terminating (SIGTERM) 06:08:49.850887 run iperf3-srv_10.42.42.10(pid=587): Terminating (SIGTERM) 06:08:49.893365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=588): Terminating (SIGTERM) 06:08:49.935823 run iperf3-srv_10.42.42.10(pid=589): Terminating (SIGTERM) 06:08:49.978438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=592): Terminating (SIGTERM) 06:08:50.021185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=595): Terminating (SIGTERM) 06:08:50.063788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=598): Terminating (SIGTERM) 06:08:50.106790 --- ParallelTerminationStrategy: PID 586 died... 06:08:50.127221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=586): Terminated: ok {rc=0} 06:08:50.173969 --- ParallelTerminationStrategy: PID 587 died... 06:08:50.194089 run iperf3-srv_10.42.42.10(pid=587): Terminated {rc=256} 06:08:50.240935 --- ParallelTerminationStrategy: PID 588 died... 06:08:50.260902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=588): Terminated: ok {rc=0} 06:08:50.307592 --- ParallelTerminationStrategy: PID 589 died... 06:08:50.327515 run iperf3-srv_10.42.42.10(pid=589): Terminated {rc=256} 06:08:50.374340 --- ParallelTerminationStrategy: PID 592 died... 06:08:50.394374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=592): Terminated: ok {rc=0} 06:08:50.441291 --- ParallelTerminationStrategy: PID 595 died... 06:08:50.461202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=595): Terminated: ok {rc=0} 06:08:50.509354 --- ParallelTerminationStrategy: PID 598 died... 06:08:50.528914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=598): Terminated: ok {rc=0} 06:08:50.618164 bus /gobi_0: Setting Powered False 06:08:51.717922 bus /gobi_0: Setting Powered False 06:08:52.832510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:08:53.984549 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:53.996566 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:08:54.050301 tst iperf3.py: using LAC 19464 06:08:54.181094 tst iperf3.py: using RAC 84 06:08:54.313673 tst iperf3.py: using CellId 19464 06:08:54.442167 tst iperf3.py: using BVCI 19465 06:08:54.562090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.573619 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.584810 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.596063 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.607262 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.618468 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.629857 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.640887 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:08:54.652235 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:08:54.772234 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:08:54.994335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:08:55.325586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=600): Launched 06:08:55.612010 run iperf3-srv_10.42.42.10(pid=601): Launched 06:08:55.734870 tst iperf3.py:8: start network... 06:08:55.955428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:08:56.464660 run create_hlr_db(pid=602): Launched 06:08:56.597200 bus /gobi_6: Setting Powered False 06:08:57.661754 run create_hlr_db(pid=602): Terminated: ok {rc=0} 06:08:58.098026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=604): Launched 06:08:58.404180 run osmo-hlr_10.42.42.2(pid=605): Launched 06:08:58.520164 run osmo-stp_10.42.42.5: Starting osmo-stp 06:08:59.067354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=607): Launched 06:08:59.374021 run osmo-stp_10.42.42.5(pid=608): Launched 06:08:59.490030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:00.015971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=610): Launched 06:09:00.133171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:00.392014 run patchelf(pid=611): Launched 06:09:00.562215 run osmo-stp_10.42.42.5(pid=608): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=608)] 06:09:00.691820 run osmo-stp_10.42.42.5(pid=608): stdout: | (launched: 2022-12-09_06:08:59.317224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:00.823371 run osmo-stp_10.42.42.5(pid=608): stderr: | 20221209060859489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060859489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060859489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060859489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060859490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060859490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060859490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:00.973484 run osmo-stp_10.42.42.5(pid=608): stdout: | (launched: 2022-12-09_06:08:59.317224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:01.115103 run osmo-stp_10.42.42.5(pid=608): stderr: | 20221209060859489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060859489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060859489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060859489 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060859490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060859490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060859490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:01.279721 run patchelf(pid=611): Terminating (SIGINT) 06:09:01.470327 run patchelf(pid=611): Terminated: ok {rc=0} 06:09:01.607642 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=608): Process ended prematurely: osmo-stp_10.42.42.5(pid=608) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=608)] [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 06:09:01.619316 tst iperf3.py:8: Test FAILED (7.7 sec) 06:09:01.649538 run osmo-hlr_10.42.42.2(pid=605): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=605)] 06:09:01.701905 run osmo-hlr_10.42.42.2(pid=605): stdout: | (launched: 2022-12-09_06:08:58.347712) 06:09:01.756542 run osmo-hlr_10.42.42.2(pid=605): stderr: | 20221209060858526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060858526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060858526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060858526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060858526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060858526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060858538 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060858547 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060858547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060858547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:01.810676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=600): Terminating (SIGTERM) 06:09:01.854101 run iperf3-srv_10.42.42.10(pid=601): Terminating (SIGTERM) 06:09:01.897663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=604): Terminating (SIGTERM) 06:09:01.942727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=607): Terminating (SIGTERM) 06:09:01.988224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=610): Terminating (SIGTERM) 06:09:02.034376 --- ParallelTerminationStrategy: PID 600 died... 06:09:02.055886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=600): Terminated: ok {rc=0} 06:09:02.104879 --- ParallelTerminationStrategy: PID 601 died... 06:09:02.126795 run iperf3-srv_10.42.42.10(pid=601): Terminated {rc=256} 06:09:02.174139 --- ParallelTerminationStrategy: PID 604 died... 06:09:02.194463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=604): Terminated: ok {rc=0} 06:09:02.241243 --- ParallelTerminationStrategy: PID 607 died... 06:09:02.261148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=607): Terminated: ok {rc=0} 06:09:02.307858 --- ParallelTerminationStrategy: PID 610 died... 06:09:02.327718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=610): Terminated: ok {rc=0} 06:09:02.416033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:09:03.564290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:03.575978 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:03.629807 tst iperf3m4.py: using LAC 19465 06:09:03.758327 tst iperf3m4.py: using RAC 85 06:09:03.885856 tst iperf3m4.py: using CellId 19465 06:09:04.013175 tst iperf3m4.py: using BVCI 19466 06:09:04.133511 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.145152 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.156422 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.167707 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.178846 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.189946 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.201655 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.212665 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:04.223929 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:04.344478 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:04.464267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:04.584265 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:04.706282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:04.929323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:05.259160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=612): Launched 06:09:05.545812 run iperf3-srv_10.42.42.10(pid=613): Launched 06:09:05.669557 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:09:05.891097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:06.221188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=614): Launched 06:09:06.506421 run iperf3-srv_10.42.42.10(pid=615): Launched 06:09:06.629635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:09:06.851091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:07.180938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=616): Launched 06:09:07.467498 run iperf3-srv_10.42.42.10(pid=617): Launched 06:09:07.590907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:09:07.811505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:08.141523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=618): Launched 06:09:08.428375 run iperf3-srv_10.42.42.10(pid=619): Launched 06:09:08.551294 tst iperf3m4.py:8: start network... 06:09:08.772109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:09.283124 run create_hlr_db(pid=620): Launched 06:09:09.416872 bus /gobi_6: Setting Powered False 06:09:10.482096 run create_hlr_db(pid=620): Terminated: ok {rc=0} 06:09:10.920332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Launched 06:09:11.251901 run osmo-hlr_10.42.42.2(pid=623): Launched 06:09:11.377436 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:11.945046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Launched 06:09:12.274054 run osmo-stp_10.42.42.5(pid=626): Launched 06:09:12.398393 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:12.963596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=628): Launched 06:09:13.088380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:13.366389 run patchelf(pid=629): Launched 06:09:13.548491 run osmo-stp_10.42.42.5(pid=626): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] 06:09:13.687924 run osmo-stp_10.42.42.5(pid=626): stdout: | (launched: 2022-12-09_06:09:12.213372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:13.828460 run osmo-stp_10.42.42.5(pid=626): stderr: | 20221209060912408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060912408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060912408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060912409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060912409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060912409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060912409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:13.968829 run osmo-stp_10.42.42.5(pid=626): stdout: | (launched: 2022-12-09_06:09:12.213372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:14.104127 run osmo-stp_10.42.42.5(pid=626): stderr: | 20221209060912408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060912408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060912408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060912409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060912409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060912409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060912409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:14.264853 run patchelf(pid=629): Terminating (SIGINT) 06:09:14.448909 run patchelf(pid=629): Terminated: ok {rc=0} 06:09:14.581587 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=626): Process ended prematurely: osmo-stp_10.42.42.5(pid=626) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 06:09:14.591811 tst iperf3m4.py:8: Test FAILED (11.1 sec) 06:09:14.620622 run osmo-hlr_10.42.42.2(pid=623): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=623)] 06:09:14.670709 run osmo-hlr_10.42.42.2(pid=623): stdout: | (launched: 2022-12-09_06:09:11.190851) 06:09:14.722714 run osmo-hlr_10.42.42.2(pid=623): stderr: | 20221209060911392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060911392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060911392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060911392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060911392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060911392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060911405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060911413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060911414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060911414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:14.775068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=612): Terminating (SIGTERM) 06:09:14.817171 run iperf3-srv_10.42.42.10(pid=613): Terminating (SIGTERM) 06:09:14.859213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=614): Terminating (SIGTERM) 06:09:14.901543 run iperf3-srv_10.42.42.10(pid=615): Terminating (SIGTERM) 06:09:14.943784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=616): Terminating (SIGTERM) 06:09:14.985804 run iperf3-srv_10.42.42.10(pid=617): Terminating (SIGTERM) 06:09:15.027765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=618): Terminating (SIGTERM) 06:09:15.069582 run iperf3-srv_10.42.42.10(pid=619): Terminating (SIGTERM) 06:09:15.111422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Terminating (SIGTERM) 06:09:15.153564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminating (SIGTERM) 06:09:15.195569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=628): Terminating (SIGTERM) 06:09:15.238182 --- ParallelTerminationStrategy: PID 612 died... 06:09:15.258410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=612): Terminated: ok {rc=0} 06:09:15.305098 --- ParallelTerminationStrategy: PID 613 died... 06:09:15.324924 run iperf3-srv_10.42.42.10(pid=613): Terminated {rc=256} 06:09:15.371006 --- ParallelTerminationStrategy: PID 614 died... 06:09:15.390700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=614): Terminated: ok {rc=0} 06:09:15.437145 --- ParallelTerminationStrategy: PID 615 died... 06:09:15.456852 run iperf3-srv_10.42.42.10(pid=615): Terminated {rc=256} 06:09:15.502776 --- ParallelTerminationStrategy: PID 616 died... 06:09:15.522500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=616): Terminated: ok {rc=0} 06:09:15.568601 --- ParallelTerminationStrategy: PID 617 died... 06:09:15.588255 run iperf3-srv_10.42.42.10(pid=617): Terminated {rc=256} 06:09:15.634250 --- ParallelTerminationStrategy: PID 618 died... 06:09:15.653943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=618): Terminated: ok {rc=0} 06:09:15.700138 --- ParallelTerminationStrategy: PID 619 died... 06:09:15.719990 run iperf3-srv_10.42.42.10(pid=619): Terminated {rc=256} 06:09:15.766317 --- ParallelTerminationStrategy: PID 622 died... 06:09:15.786226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=622): Terminated: ok {rc=0} 06:09:15.832399 --- ParallelTerminationStrategy: PID 625 died... 06:09:15.852431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=625): Terminated: ok {rc=0} 06:09:15.899190 --- ParallelTerminationStrategy: PID 628 died... 06:09:15.919366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=628): Terminated: ok {rc=0} 06:09:16.009138 bus /gobi_4: Setting Powered False 06:09:17.121994 bus /gobi_4: Setting Powered False 06:09:18.253109 bus /gobi_1: Setting Powered False 06:09:19.353044 bus /gobi_1: Setting Powered False 06:09:20.468928 bus /gobi_0: Setting Powered False 06:09:21.568498 bus /gobi_0: Setting Powered False 06:09:22.683227 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 06:09:23.788379 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:23.800425 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:23.852399 tst ping.py: using LAC 19466 06:09:23.980022 tst ping.py: using RAC 86 06:09:24.098693 tst ping.py: using CellId 19466 06:09:24.218454 tst ping.py: using BVCI 19467 06:09:24.329492 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.340547 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.351472 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.363087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.374468 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.385709 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.397345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:24.408583 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:24.526871 tst ping.py:19: start network... 06:09:24.746119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:25.248352 run create_hlr_db(pid=630): Launched 06:09:25.381374 bus /gobi_6: Setting Powered False 06:09:26.445545 run create_hlr_db(pid=630): Terminated: ok {rc=0} 06:09:26.897894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=632): Launched 06:09:27.222332 run osmo-hlr_10.42.42.2(pid=633): Launched 06:09:27.345550 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:27.903886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Launched 06:09:28.227019 run osmo-stp_10.42.42.5(pid=636): Launched 06:09:28.350000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:28.906251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=638): Launched 06:09:29.030527 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:29.304675 run patchelf(pid=639): Launched 06:09:29.484426 run osmo-stp_10.42.42.5(pid=636): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=636)] 06:09:29.621615 run osmo-stp_10.42.42.5(pid=636): stdout: | (launched: 2022-12-09_06:09:28.167504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:29.760212 run osmo-stp_10.42.42.5(pid=636): stderr: | 20221209060928358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060928359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060928359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060928359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060928360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060928360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060928360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:29.898685 run osmo-stp_10.42.42.5(pid=636): stdout: | (launched: 2022-12-09_06:09:28.167504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:30.031105 run osmo-stp_10.42.42.5(pid=636): stderr: | 20221209060928358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060928359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060928359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060928359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060928360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060928360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060928360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:30.187622 run patchelf(pid=639): Terminating (SIGINT) 06:09:30.369104 run patchelf(pid=639): Terminated: ok {rc=0} 06:09:30.498988 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=636): Process ended prematurely: osmo-stp_10.42.42.5(pid=636) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=636)] [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 06:09:30.508393 tst ping.py:22: Test FAILED (6.7 sec) 06:09:30.536755 run osmo-hlr_10.42.42.2(pid=633): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=633)] 06:09:30.587338 run osmo-hlr_10.42.42.2(pid=633): stdout: | (launched: 2022-12-09_06:09:27.162382) 06:09:30.639660 run osmo-hlr_10.42.42.2(pid=633): stderr: | 20221209060927361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060927361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060927361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060927361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060927361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060927361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060927376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060927384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060927385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060927385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:30.692498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=632): Terminating (SIGTERM) 06:09:30.734921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Terminating (SIGTERM) 06:09:30.777472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=638): Terminating (SIGTERM) 06:09:30.820285 --- ParallelTerminationStrategy: PID 632 died... 06:09:30.841005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=632): Terminated: ok {rc=0} 06:09:30.888778 --- ParallelTerminationStrategy: PID 635 died... 06:09:30.915101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Terminated: ok {rc=0} 06:09:30.962882 --- ParallelTerminationStrategy: PID 638 died... 06:09:30.983310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=638): Terminated: ok {rc=0} 06:09:31.075189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:09:32.162863 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.175509 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:09:32.237026 tst ping_idle_ping.py: using LAC 19467 06:09:32.373271 tst ping_idle_ping.py: using RAC 87 06:09:32.498433 tst ping_idle_ping.py: using CellId 19467 06:09:32.631775 tst ping_idle_ping.py: using BVCI 19468 06:09:32.749789 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.761725 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.773099 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.784422 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.795830 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.807137 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.818559 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:09:32.829998 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:09:32.945628 tst ping_idle_ping.py:24: start network... 06:09:33.149395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:33.619739 run create_hlr_db(pid=640): Launched 06:09:33.734772 bus /gobi_6: Setting Powered False 06:09:34.795223 run create_hlr_db(pid=640): Terminated: ok {rc=0} 06:09:35.242079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Launched 06:09:35.568591 run osmo-hlr_10.42.42.2(pid=643): Launched 06:09:35.693098 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:36.251559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Launched 06:09:36.576642 run osmo-stp_10.42.42.5(pid=646): Launched 06:09:36.699850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:37.259732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Launched 06:09:37.383926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:37.657649 run patchelf(pid=649): Launched 06:09:37.838150 run osmo-stp_10.42.42.5(pid=646): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] 06:09:37.975432 run osmo-stp_10.42.42.5(pid=646): stdout: | (launched: 2022-12-09_06:09:36.516405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:38.115068 run osmo-stp_10.42.42.5(pid=646): stderr: | 20221209060936712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060936713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060936713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060936713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060936714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060936714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060936714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:38.254315 run osmo-stp_10.42.42.5(pid=646): stdout: | (launched: 2022-12-09_06:09:36.516405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:38.387321 run osmo-stp_10.42.42.5(pid=646): stderr: | 20221209060936712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060936713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060936713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060936713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060936714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060936714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060936714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:38.544691 run patchelf(pid=649): Terminating (SIGINT) 06:09:38.726577 run patchelf(pid=649): Terminated: ok {rc=0} 06:09:38.857657 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=646): Process ended prematurely: osmo-stp_10.42.42.5(pid=646) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 06:09:38.867123 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:09:38.895542 run osmo-hlr_10.42.42.2(pid=643): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=643)] 06:09:38.946352 run osmo-hlr_10.42.42.2(pid=643): stdout: | (launched: 2022-12-09_06:09:35.508343) 06:09:38.999243 run osmo-hlr_10.42.42.2(pid=643): stderr: | 20221209060935707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060935707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060935707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060935707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060935708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060935708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060935720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060935728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060935729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060935729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:39.052207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Terminating (SIGTERM) 06:09:39.095381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Terminating (SIGTERM) 06:09:39.138327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Terminating (SIGTERM) 06:09:39.181230 --- ParallelTerminationStrategy: PID 642 died... 06:09:39.201506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=642): Terminated: ok {rc=0} 06:09:39.248784 --- ParallelTerminationStrategy: PID 645 died... 06:09:39.269006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=645): Terminated: ok {rc=0} 06:09:39.315687 --- ParallelTerminationStrategy: PID 648 died... 06:09:39.335726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=648): Terminated: ok {rc=0} 06:09:39.423647 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:09:40.723485 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:09:40.729649 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:09:40.763028 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:09:40.801635 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:09:40.889464 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:09:40.923524 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:09:40.962214 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:09:41.555199 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:09:41.607121 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:41.618283 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:41.686294 tst cs_paging_gprs_active.py: using LAC 19468 06:09:41.805450 tst cs_paging_gprs_active.py: using RAC 88 06:09:41.934421 tst cs_paging_gprs_active.py: using CellId 19468 06:09:42.062307 tst cs_paging_gprs_active.py: using BVCI 19469 06:09:42.184192 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.195753 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.207170 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.218913 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.230165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.241417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.252619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.263762 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:42.275288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:42.391537 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:42.511375 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:09:42.717695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:43.025676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Launched 06:09:43.294154 run iperf3-srv_10.42.42.10(pid=654): Launched 06:09:43.408552 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:09:43.612323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:43.919311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=655): Launched 06:09:44.185505 run iperf3-srv_10.42.42.10(pid=656): Launched 06:09:44.300568 tst cs_paging_gprs_active.py:38: start network... 06:09:44.505576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:44.981307 run create_hlr_db(pid=657): Launched 06:09:45.099164 bus /gobi_6: Setting Powered False 06:09:46.178473 run create_hlr_db(pid=657): Terminated: ok {rc=0} 06:09:46.655239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=659): Launched 06:09:47.008626 run osmo-hlr_10.42.42.2(pid=660): Launched 06:09:47.187537 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:47.715238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=662): Launched 06:09:48.021387 run osmo-stp_10.42.42.5(pid=663): Launched 06:09:48.137408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:09:48.666542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=665): Launched 06:09:48.783763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:09:49.049689 run patchelf(pid=666): Launched 06:09:49.220906 run osmo-stp_10.42.42.5(pid=663): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=663)] 06:09:49.350647 run osmo-stp_10.42.42.5(pid=663): stdout: | (launched: 2022-12-09_06:09:47.964562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:49.482075 run osmo-stp_10.42.42.5(pid=663): stderr: | 20221209060948138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060948138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060948139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060948139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060948140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060948140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060948140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:49.613758 run osmo-stp_10.42.42.5(pid=663): stdout: | (launched: 2022-12-09_06:09:47.964562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:09:49.739671 run osmo-stp_10.42.42.5(pid=663): stderr: | 20221209060948138 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209060948138 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209060948139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209060948139 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209060948140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209060948140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209060948140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:09:49.888448 run patchelf(pid=666): Terminating (SIGINT) 06:09:50.061090 run patchelf(pid=666): Terminated: ok {rc=0} 06:09:50.185913 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=663): Process ended prematurely: osmo-stp_10.42.42.5(pid=663) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=663)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:09:50.195416 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 06:09:50.223340 run osmo-hlr_10.42.42.2(pid=660): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=660)] 06:09:50.272173 run osmo-hlr_10.42.42.2(pid=660): stdout: | (launched: 2022-12-09_06:09:46.945088) 06:09:50.322166 run osmo-hlr_10.42.42.2(pid=660): stderr: | 20221209060947191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060947191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060947191 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060947191 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060947191 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060947191 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060947203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060947212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060947212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060947212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:09:50.372740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Terminating (SIGTERM) 06:09:50.413158 run iperf3-srv_10.42.42.10(pid=654): Terminating (SIGTERM) 06:09:50.454042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=655): Terminating (SIGTERM) 06:09:50.494857 run iperf3-srv_10.42.42.10(pid=656): Terminating (SIGTERM) 06:09:50.535211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=659): Terminating (SIGTERM) 06:09:50.575455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=662): Terminating (SIGTERM) 06:09:50.615636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=665): Terminating (SIGTERM) 06:09:50.656197 --- ParallelTerminationStrategy: PID 653 died... 06:09:50.675447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Terminated: ok {rc=0} 06:09:50.720227 --- ParallelTerminationStrategy: PID 654 died... 06:09:50.738993 run iperf3-srv_10.42.42.10(pid=654): Terminated {rc=256} 06:09:50.783386 --- ParallelTerminationStrategy: PID 655 died... 06:09:50.802177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=655): Terminated: ok {rc=0} 06:09:50.846724 --- ParallelTerminationStrategy: PID 656 died... 06:09:50.865338 run iperf3-srv_10.42.42.10(pid=656): Terminated {rc=256} 06:09:50.909649 --- ParallelTerminationStrategy: PID 659 died... 06:09:50.928455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=659): Terminated: ok {rc=0} 06:09:50.973194 --- ParallelTerminationStrategy: PID 662 died... 06:09:50.991905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=662): Terminated: ok {rc=0} 06:09:51.036586 --- ParallelTerminationStrategy: PID 665 died... 06:09:51.055462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=665): Terminated: ok {rc=0} 06:09:51.141541 bus /gobi_0: Setting Powered False 06:09:52.242812 bus /gobi_0: Setting Powered False 06:09:53.358720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:09:54.509947 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:54.522389 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:09:54.594845 tst iperf3.py: using LAC 19469 06:09:54.726361 tst iperf3.py: using RAC 89 06:09:54.856632 tst iperf3.py: using CellId 19469 06:09:54.985913 tst iperf3.py: using BVCI 19470 06:09:55.107122 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.118659 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.129971 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.141740 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.153447 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.165158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.177027 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.188737 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:09:55.200616 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:09:55.322169 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:09:55.545584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:09:55.875943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=667): Launched 06:09:56.162768 run iperf3-srv_10.42.42.10(pid=668): Launched 06:09:56.287175 tst iperf3.py:8: start network... 06:09:56.509447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:09:57.020113 run create_hlr_db(pid=669): Launched 06:09:57.154598 bus /gobi_6: Setting Powered False 06:09:58.219029 run create_hlr_db(pid=669): Terminated: ok {rc=0} 06:09:58.656615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=671): Launched 06:09:58.963599 run osmo-hlr_10.42.42.2(pid=672): Launched 06:09:59.080660 run osmo-stp_10.42.42.5: Starting osmo-stp 06:09:59.727412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=675): Launched 06:10:00.026629 run osmo-stp_10.42.42.5(pid=676): Launched 06:10:00.140376 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:00.659738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=678): Launched 06:10:00.775041 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:01.062594 run patchelf(pid=679): Launched 06:10:01.244836 run osmo-stp_10.42.42.5(pid=676): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=676)] 06:10:01.376593 run osmo-stp_10.42.42.5(pid=676): stdout: | (launched: 2022-12-09_06:09:59.971475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:01.509628 run osmo-stp_10.42.42.5(pid=676): stderr: | 20221209061000143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061000144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061000144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061000144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061000146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061000147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061000147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:01.651238 run osmo-stp_10.42.42.5(pid=676): stdout: | (launched: 2022-12-09_06:09:59.971475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:01.801397 run osmo-stp_10.42.42.5(pid=676): stderr: | 20221209061000143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061000144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061000144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061000144 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061000146 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061000147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061000147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:01.967770 run patchelf(pid=679): Terminating (SIGINT) 06:10:02.160277 run patchelf(pid=679): Terminated: ok {rc=0} 06:10:02.294191 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=676): Process ended prematurely: osmo-stp_10.42.42.5(pid=676) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=676)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 06:10:02.304904 tst iperf3.py:8: Test FAILED (7.8 sec) 06:10:02.334368 run osmo-hlr_10.42.42.2(pid=672): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=672)] 06:10:02.386295 run osmo-hlr_10.42.42.2(pid=672): stdout: | (launched: 2022-12-09_06:09:58.906998) 06:10:02.439312 run osmo-hlr_10.42.42.2(pid=672): stderr: | 20221209060959083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209060959083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209060959083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209060959083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209060959083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209060959084 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209060959096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209060959105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209060959105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209060959105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:02.493290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=667): Terminating (SIGTERM) 06:10:02.536142 run iperf3-srv_10.42.42.10(pid=668): Terminating (SIGTERM) 06:10:02.578990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=671): Terminating (SIGTERM) 06:10:02.621915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=675): Terminating (SIGTERM) 06:10:02.665128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=678): Terminating (SIGTERM) 06:10:02.708566 --- ParallelTerminationStrategy: PID 667 died... 06:10:02.729138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=667): Terminated: ok {rc=0} 06:10:02.777044 --- ParallelTerminationStrategy: PID 668 died... 06:10:02.797332 run iperf3-srv_10.42.42.10(pid=668): Terminated {rc=256} 06:10:02.844686 --- ParallelTerminationStrategy: PID 671 died... 06:10:02.864859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=671): Terminated: ok {rc=0} 06:10:02.912256 --- ParallelTerminationStrategy: PID 675 died... 06:10:02.932258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=675): Terminated: ok {rc=0} 06:10:02.979657 --- ParallelTerminationStrategy: PID 678 died... 06:10:02.999636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=678): Terminated: ok {rc=0} 06:10:03.088929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:10:04.241636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.253891 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:04.325351 tst iperf3m4.py: using LAC 19470 06:10:04.451845 tst iperf3m4.py: using RAC 90 06:10:04.581101 tst iperf3m4.py: using CellId 19470 06:10:04.707798 tst iperf3m4.py: using BVCI 19471 06:10:04.824874 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.836564 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.848020 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.859467 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.870914 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.882542 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.894043 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.905438 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:04.916859 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:05.032754 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:05.153889 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:05.272582 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:05.390574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:05.591652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:05.893423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Launched 06:10:06.154686 run iperf3-srv_10.42.42.10(pid=684): Launched 06:10:06.267221 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:10:06.466539 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:06.766874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=685): Launched 06:10:07.028490 run iperf3-srv_10.42.42.10(pid=686): Launched 06:10:07.141014 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:10:07.341233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:07.642194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=687): Launched 06:10:07.903705 run iperf3-srv_10.42.42.10(pid=688): Launched 06:10:08.016029 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:10:08.215721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:08.516484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=689): Launched 06:10:08.778214 run iperf3-srv_10.42.42.10(pid=690): Launched 06:10:08.890304 tst iperf3m4.py:8: start network... 06:10:09.089759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:09.557024 run create_hlr_db(pid=691): Launched 06:10:09.671829 bus /gobi_6: Setting Powered False 06:10:10.731259 run create_hlr_db(pid=691): Terminated: ok {rc=0} 06:10:11.150565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=693): Launched 06:10:11.451681 run osmo-hlr_10.42.42.2(pid=694): Launched 06:10:11.566327 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:12.096574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=696): Launched 06:10:12.397976 run osmo-stp_10.42.42.5(pid=697): Launched 06:10:12.512620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:13.032095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=699): Launched 06:10:13.146973 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:13.401941 run patchelf(pid=700): Launched 06:10:13.569491 run osmo-stp_10.42.42.5(pid=697): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=697)] 06:10:13.696939 run osmo-stp_10.42.42.5(pid=697): stdout: | (launched: 2022-12-09_06:10:12.341430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:13.825920 run osmo-stp_10.42.42.5(pid=697): stderr: | 20221209061012513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061012514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061012514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061012514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061012515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061012515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061012515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:13.955058 run osmo-stp_10.42.42.5(pid=697): stdout: | (launched: 2022-12-09_06:10:12.341430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:14.079273 run osmo-stp_10.42.42.5(pid=697): stderr: | 20221209061012513 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061012514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061012514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061012514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061012515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061012515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061012515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:14.226569 run patchelf(pid=700): Terminating (SIGINT) 06:10:14.395783 run patchelf(pid=700): Terminated: ok {rc=0} 06:10:14.517610 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=697): Process ended prematurely: osmo-stp_10.42.42.5(pid=697) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=697)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:10:14.527093 tst iperf3m4.py:8: Test FAILED (10.3 sec) 06:10:14.554911 run osmo-hlr_10.42.42.2(pid=694): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=694)] 06:10:14.603647 run osmo-hlr_10.42.42.2(pid=694): stdout: | (launched: 2022-12-09_06:10:11.395927) 06:10:14.654036 run osmo-hlr_10.42.42.2(pid=694): stderr: | 20221209061011574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061011574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061011574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061011574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061011574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061011574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061011586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061011594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061011595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061011595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:14.704645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Terminating (SIGTERM) 06:10:14.745508 run iperf3-srv_10.42.42.10(pid=684): Terminating (SIGTERM) 06:10:14.786219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=685): Terminating (SIGTERM) 06:10:14.826900 run iperf3-srv_10.42.42.10(pid=686): Terminating (SIGTERM) 06:10:14.867399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=687): Terminating (SIGTERM) 06:10:14.908023 run iperf3-srv_10.42.42.10(pid=688): Terminating (SIGTERM) 06:10:14.948325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=689): Terminating (SIGTERM) 06:10:14.988702 run iperf3-srv_10.42.42.10(pid=690): Terminating (SIGTERM) 06:10:15.029145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=693): Terminating (SIGTERM) 06:10:15.069938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=696): Terminating (SIGTERM) 06:10:15.110369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=699): Terminating (SIGTERM) 06:10:15.151235 --- ParallelTerminationStrategy: PID 683 died... 06:10:15.170434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Terminated: ok {rc=0} 06:10:15.215379 --- ParallelTerminationStrategy: PID 684 died... 06:10:15.234125 run iperf3-srv_10.42.42.10(pid=684): Terminated {rc=256} 06:10:15.278854 --- ParallelTerminationStrategy: PID 685 died... 06:10:15.297532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=685): Terminated: ok {rc=0} 06:10:15.341980 --- ParallelTerminationStrategy: PID 686 died... 06:10:15.360703 run iperf3-srv_10.42.42.10(pid=686): Terminated {rc=256} 06:10:15.405384 --- ParallelTerminationStrategy: PID 687 died... 06:10:15.423983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=687): Terminated: ok {rc=0} 06:10:15.469831 --- ParallelTerminationStrategy: PID 688 died... 06:10:15.488619 run iperf3-srv_10.42.42.10(pid=688): Terminated {rc=256} 06:10:15.533413 --- ParallelTerminationStrategy: PID 689 died... 06:10:15.552567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=689): Terminated: ok {rc=0} 06:10:15.597460 --- ParallelTerminationStrategy: PID 690 died... 06:10:15.616281 run iperf3-srv_10.42.42.10(pid=690): Terminated {rc=256} 06:10:15.661074 --- ParallelTerminationStrategy: PID 693 died... 06:10:15.679797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=693): Terminated: ok {rc=0} 06:10:15.725060 --- ParallelTerminationStrategy: PID 696 died... 06:10:15.743782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=696): Terminated: ok {rc=0} 06:10:15.788320 --- ParallelTerminationStrategy: PID 699 died... 06:10:15.807450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=699): Terminated: ok {rc=0} 06:10:15.914564 bus /gobi_4: Setting Powered False 06:10:17.015005 bus /gobi_4: Setting Powered False 06:10:18.132039 bus /gobi_1: Setting Powered False 06:10:19.231454 bus /gobi_1: Setting Powered False 06:10:20.352083 bus /gobi_0: Setting Powered False 06:10:21.451978 bus /gobi_0: Setting Powered False 06:10:22.567904 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:10:23.672161 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:23.684011 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:23.753638 tst ping.py: using LAC 19471 06:10:23.880053 tst ping.py: using RAC 91 06:10:24.007122 tst ping.py: using CellId 19471 06:10:24.130799 tst ping.py: using BVCI 19472 06:10:24.246185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.257854 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.269137 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.280294 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.291520 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.302730 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.314123 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:24.325324 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:24.440500 tst ping.py:19: start network... 06:10:24.638124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:25.098725 run create_hlr_db(pid=702): Launched 06:10:25.212115 bus /gobi_6: Setting Powered False 06:10:26.276124 run create_hlr_db(pid=702): Terminated: ok {rc=0} 06:10:26.718519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=704): Launched 06:10:27.034523 run osmo-hlr_10.42.42.2(pid=705): Launched 06:10:27.155183 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:27.701893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=707): Launched 06:10:28.018650 run osmo-stp_10.42.42.5(pid=708): Launched 06:10:28.139067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:28.685546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=710): Launched 06:10:28.806869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:29.074927 run patchelf(pid=711): Launched 06:10:29.251470 run osmo-stp_10.42.42.5(pid=708): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=708)] 06:10:29.386614 run osmo-stp_10.42.42.5(pid=708): stdout: | (launched: 2022-12-09_06:10:27.960432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:29.522941 run osmo-stp_10.42.42.5(pid=708): stderr: | 20221209061028154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061028154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061028154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061028155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061028155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061028155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061028155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:29.658949 run osmo-stp_10.42.42.5(pid=708): stdout: | (launched: 2022-12-09_06:10:27.960432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:29.788763 run osmo-stp_10.42.42.5(pid=708): stderr: | 20221209061028154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061028154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061028154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061028155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061028155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061028155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061028155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:29.942746 run patchelf(pid=711): Terminating (SIGINT) 06:10:30.120115 run patchelf(pid=711): Terminated: ok {rc=0} 06:10:30.248552 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=708): Process ended prematurely: osmo-stp_10.42.42.5(pid=708) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=708)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 06:10:30.258270 tst ping.py:22: Test FAILED (6.6 sec) 06:10:30.286453 run osmo-hlr_10.42.42.2(pid=705): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=705)] 06:10:30.337176 run osmo-hlr_10.42.42.2(pid=705): stdout: | (launched: 2022-12-09_06:10:26.976432) 06:10:30.389343 run osmo-hlr_10.42.42.2(pid=705): stderr: | 20221209061027174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061027174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061027175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061027175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061027175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061027175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061027187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061027196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061027197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061027197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:30.442085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=704): Terminating (SIGTERM) 06:10:30.484303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=707): Terminating (SIGTERM) 06:10:30.526790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=710): Terminating (SIGTERM) 06:10:30.569251 --- ParallelTerminationStrategy: PID 704 died... 06:10:30.589313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=704): Terminated: ok {rc=0} 06:10:30.635917 --- ParallelTerminationStrategy: PID 707 died... 06:10:30.655589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=707): Terminated: ok {rc=0} 06:10:30.702048 --- ParallelTerminationStrategy: PID 710 died... 06:10:30.721725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=710): Terminated: ok {rc=0} 06:10:30.810484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:10:31.911793 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:31.927218 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:10:32.015374 tst ping_idle_ping.py: using LAC 19472 06:10:32.135960 tst ping_idle_ping.py: using RAC 92 06:10:32.255890 tst ping_idle_ping.py: using CellId 19472 06:10:32.377421 tst ping_idle_ping.py: using BVCI 19473 06:10:32.485236 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.496554 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.507510 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.518877 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.530033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.541264 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.552476 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:10:32.563184 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:10:32.677341 tst ping_idle_ping.py:24: start network... 06:10:32.876439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:33.335566 run create_hlr_db(pid=713): Launched 06:10:33.447358 bus /gobi_6: Setting Powered False 06:10:34.507058 run create_hlr_db(pid=713): Terminated: ok {rc=0} 06:10:34.942273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=715): Launched 06:10:35.259291 run osmo-hlr_10.42.42.2(pid=716): Launched 06:10:35.380024 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:35.930620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=718): Launched 06:10:36.248743 run osmo-stp_10.42.42.5(pid=719): Launched 06:10:36.369622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:36.916931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=721): Launched 06:10:37.038248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:37.306662 run patchelf(pid=722): Launched 06:10:37.483454 run osmo-stp_10.42.42.5(pid=719): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=719)] 06:10:37.619141 run osmo-stp_10.42.42.5(pid=719): stdout: | (launched: 2022-12-09_06:10:36.190373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:37.760251 run osmo-stp_10.42.42.5(pid=719): stderr: | 20221209061036382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061036382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061036383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061036383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061036383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061036384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061036384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:37.895961 run osmo-stp_10.42.42.5(pid=719): stdout: | (launched: 2022-12-09_06:10:36.190373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:38.026645 run osmo-stp_10.42.42.5(pid=719): stderr: | 20221209061036382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061036382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061036383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061036383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061036383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061036384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061036384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:38.180268 run patchelf(pid=722): Terminating (SIGINT) 06:10:38.358881 run patchelf(pid=722): Terminated: ok {rc=0} 06:10:38.486588 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=719): Process ended prematurely: osmo-stp_10.42.42.5(pid=719) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=719)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:10:38.496119 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:10:38.524295 run osmo-hlr_10.42.42.2(pid=716): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=716)] 06:10:38.574801 run osmo-hlr_10.42.42.2(pid=716): stdout: | (launched: 2022-12-09_06:10:35.200620) 06:10:38.627556 run osmo-hlr_10.42.42.2(pid=716): stderr: | 20221209061035398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061035398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061035398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061035398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061035398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061035398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061035410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061035419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061035419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061035419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:38.680180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=715): Terminating (SIGTERM) 06:10:38.722614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=718): Terminating (SIGTERM) 06:10:38.764996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=721): Terminating (SIGTERM) 06:10:38.807500 --- ParallelTerminationStrategy: PID 715 died... 06:10:38.827662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=715): Terminated: ok {rc=0} 06:10:38.874693 --- ParallelTerminationStrategy: PID 718 died... 06:10:38.894494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=718): Terminated: ok {rc=0} 06:10:38.941208 --- ParallelTerminationStrategy: PID 721 died... 06:10:38.960861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=721): Terminated: ok {rc=0} 06:10:39.049615 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:10:40.352784 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:10:40.359294 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:10:40.391878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:10:40.430933 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:10:40.517268 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:10:40.550556 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:10:40.590067 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:10:41.180563 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:10:41.229798 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.240801 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:41.309656 tst cs_paging_gprs_active.py: using LAC 19473 06:10:41.426787 tst cs_paging_gprs_active.py: using RAC 93 06:10:41.544136 tst cs_paging_gprs_active.py: using CellId 19473 06:10:41.664666 tst cs_paging_gprs_active.py: using BVCI 19474 06:10:41.775233 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.786079 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.796621 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.807669 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.818529 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.830024 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.841193 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.852175 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:41.863347 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:42.005586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:42.129772 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:10:42.348544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:42.673714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=726): Launched 06:10:42.954590 run iperf3-srv_10.42.42.10(pid=727): Launched 06:10:43.075655 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:10:43.292487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:43.616348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Launched 06:10:43.897305 run iperf3-srv_10.42.42.10(pid=729): Launched 06:10:44.018094 tst cs_paging_gprs_active.py:38: start network... 06:10:44.234840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:44.734645 run create_hlr_db(pid=730): Launched 06:10:44.866277 bus /gobi_6: Setting Powered False 06:10:45.936776 run create_hlr_db(pid=730): Terminated: ok {rc=0} 06:10:46.388843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Launched 06:10:46.710894 run osmo-hlr_10.42.42.2(pid=733): Launched 06:10:46.888430 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:47.582721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Launched 06:10:47.884299 run osmo-stp_10.42.42.5(pid=736): Launched 06:10:48.002915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:10:48.518589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Launched 06:10:48.631891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:10:48.883626 run patchelf(pid=739): Launched 06:10:49.048698 run osmo-stp_10.42.42.5(pid=736): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] 06:10:49.174952 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-09_06:10:47.828582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:49.302199 run osmo-stp_10.42.42.5(pid=736): stderr: | 20221209061048000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061048000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061048000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061048001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061048001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061048001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061048001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:49.429574 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-09_06:10:47.828582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:10:49.551576 run osmo-stp_10.42.42.5(pid=736): stderr: | 20221209061048000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061048000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061048000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061048001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061048001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061048001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061048001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:10:49.696036 run patchelf(pid=739): Terminating (SIGINT) 06:10:49.863195 run patchelf(pid=739): Terminated: ok {rc=0} 06:10:49.984055 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=736): Process ended prematurely: osmo-stp_10.42.42.5(pid=736) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:10:49.993462 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:10:50.020466 run osmo-hlr_10.42.42.2(pid=733): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=733)] 06:10:50.068380 run osmo-hlr_10.42.42.2(pid=733): stdout: | (launched: 2022-12-09_06:10:46.646102) 06:10:50.118054 run osmo-hlr_10.42.42.2(pid=733): stderr: | 20221209061046991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061046991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061046991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061046991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061046991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061046991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061047006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061047030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061047031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061047031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:10:50.167914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=726): Terminating (SIGTERM) 06:10:50.208272 run iperf3-srv_10.42.42.10(pid=727): Terminating (SIGTERM) 06:10:50.248517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Terminating (SIGTERM) 06:10:50.288747 run iperf3-srv_10.42.42.10(pid=729): Terminating (SIGTERM) 06:10:50.329503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminating (SIGTERM) 06:10:50.369632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminating (SIGTERM) 06:10:50.409726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Terminating (SIGTERM) 06:10:50.449931 --- ParallelTerminationStrategy: PID 726 died... 06:10:50.468800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=726): Terminated: ok {rc=0} 06:10:50.513217 --- ParallelTerminationStrategy: PID 727 died... 06:10:50.531752 run iperf3-srv_10.42.42.10(pid=727): Terminated {rc=256} 06:10:50.576552 --- ParallelTerminationStrategy: PID 728 died... 06:10:50.595134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Terminated: ok {rc=0} 06:10:50.639715 --- ParallelTerminationStrategy: PID 729 died... 06:10:50.658221 run iperf3-srv_10.42.42.10(pid=729): Terminated {rc=256} 06:10:50.702291 --- ParallelTerminationStrategy: PID 732 died... 06:10:50.720896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminated: ok {rc=0} 06:10:50.765431 --- ParallelTerminationStrategy: PID 735 died... 06:10:50.783912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminated: ok {rc=0} 06:10:50.828558 --- ParallelTerminationStrategy: PID 738 died... 06:10:50.847237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Terminated: ok {rc=0} 06:10:50.930866 bus /gobi_0: Setting Powered False 06:10:52.030548 bus /gobi_0: Setting Powered False 06:10:53.146277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:10:54.295217 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.307032 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:10:54.378770 tst iperf3.py: using LAC 19474 06:10:54.505721 tst iperf3.py: using RAC 94 06:10:54.632689 tst iperf3.py: using CellId 19474 06:10:54.761272 tst iperf3.py: using BVCI 19475 06:10:54.878579 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.889884 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.901029 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.912083 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.923000 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.934071 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.945237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.956189 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:10:54.967384 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:10:55.080532 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:10:55.279552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:10:55.575544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Launched 06:10:55.834283 run iperf3-srv_10.42.42.10(pid=741): Launched 06:10:55.945355 tst iperf3.py:8: start network... 06:10:56.143147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:10:56.602842 run create_hlr_db(pid=742): Launched 06:10:56.716475 bus /gobi_6: Setting Powered False 06:10:57.776334 run create_hlr_db(pid=742): Terminated: ok {rc=0} 06:10:58.209263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=744): Launched 06:10:58.525985 run osmo-hlr_10.42.42.2(pid=745): Launched 06:10:58.646561 run osmo-stp_10.42.42.5: Starting osmo-stp 06:10:59.197407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=747): Launched 06:10:59.514546 run osmo-stp_10.42.42.5(pid=748): Launched 06:10:59.635862 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:00.182603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=750): Launched 06:11:00.303605 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:00.570374 run patchelf(pid=751): Launched 06:11:00.746598 run osmo-stp_10.42.42.5(pid=748): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=748)] 06:11:00.896177 run osmo-stp_10.42.42.5(pid=748): stdout: | (launched: 2022-12-09_06:10:59.455950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:01.031301 run osmo-stp_10.42.42.5(pid=748): stderr: | 20221209061059648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061059648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061059648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061059649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061059649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061059649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061059649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:01.166110 run osmo-stp_10.42.42.5(pid=748): stdout: | (launched: 2022-12-09_06:10:59.455950) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:01.292342 run osmo-stp_10.42.42.5(pid=748): stderr: | 20221209061059648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061059648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061059648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061059649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061059649 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061059649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061059649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:01.443839 run patchelf(pid=751): Terminating (SIGINT) 06:11:01.618608 run patchelf(pid=751): Terminated: ok {rc=0} 06:11:01.744831 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=748): Process ended prematurely: osmo-stp_10.42.42.5(pid=748) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=748)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 06:11:01.755376 tst iperf3.py:8: Test FAILED (7.5 sec) 06:11:01.785125 run osmo-hlr_10.42.42.2(pid=745): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=745)] 06:11:01.837286 run osmo-hlr_10.42.42.2(pid=745): stdout: | (launched: 2022-12-09_06:10:58.468232) 06:11:01.891004 run osmo-hlr_10.42.42.2(pid=745): stderr: | 20221209061058667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061058667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061058667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061058667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061058667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061058667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061058678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061058686 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061058687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061058687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:01.945793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Terminating (SIGTERM) 06:11:01.988652 run iperf3-srv_10.42.42.10(pid=741): Terminating (SIGTERM) 06:11:02.031465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=744): Terminating (SIGTERM) 06:11:02.075675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=747): Terminating (SIGTERM) 06:11:02.122014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=750): Terminating (SIGTERM) 06:11:02.167992 --- ParallelTerminationStrategy: PID 740 died... 06:11:02.187995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Terminated: ok {rc=0} 06:11:02.234361 --- ParallelTerminationStrategy: PID 741 died... 06:11:02.254168 run iperf3-srv_10.42.42.10(pid=741): Terminated {rc=256} 06:11:02.300343 --- ParallelTerminationStrategy: PID 744 died... 06:11:02.320105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=744): Terminated: ok {rc=0} 06:11:02.366185 --- ParallelTerminationStrategy: PID 747 died... 06:11:02.385670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=747): Terminated: ok {rc=0} 06:11:02.431757 --- ParallelTerminationStrategy: PID 750 died... 06:11:02.451175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=750): Terminated: ok {rc=0} 06:11:02.539210 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:11:03.692691 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:03.704710 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:03.775261 tst iperf3m4.py: using LAC 19475 06:11:03.901013 tst iperf3m4.py: using RAC 95 06:11:04.025288 tst iperf3m4.py: using CellId 19475 06:11:04.151696 tst iperf3m4.py: using BVCI 19476 06:11:04.261309 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.272266 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.283176 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.294423 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.305541 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.316723 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.328099 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.339022 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:04.350241 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:04.464319 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:04.585624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:04.701920 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:04.815599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:05.013512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:05.310173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=752): Launched 06:11:05.567871 run iperf3-srv_10.42.42.10(pid=753): Launched 06:11:05.680012 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:11:05.878590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:06.175061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=754): Launched 06:11:06.432753 run iperf3-srv_10.42.42.10(pid=755): Launched 06:11:06.544479 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:11:06.742294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:07.038868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=756): Launched 06:11:07.297374 run iperf3-srv_10.42.42.10(pid=757): Launched 06:11:07.408655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:11:07.606830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:07.904564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=758): Launched 06:11:08.162889 run iperf3-srv_10.42.42.10(pid=759): Launched 06:11:08.275177 tst iperf3m4.py:8: start network... 06:11:08.472910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:08.933597 run create_hlr_db(pid=760): Launched 06:11:09.046053 bus /gobi_6: Setting Powered False 06:11:10.106091 run create_hlr_db(pid=760): Terminated: ok {rc=0} 06:11:10.521148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=762): Launched 06:11:10.817446 run osmo-hlr_10.42.42.2(pid=763): Launched 06:11:10.930674 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:11.439211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=765): Launched 06:11:11.735449 run osmo-stp_10.42.42.5(pid=766): Launched 06:11:11.848197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:12.358372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=768): Launched 06:11:12.472007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:12.723287 run patchelf(pid=769): Launched 06:11:12.888573 run osmo-stp_10.42.42.5(pid=766): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=766)] 06:11:13.014951 run osmo-stp_10.42.42.5(pid=766): stdout: | (launched: 2022-12-09_06:11:11.681337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:13.142529 run osmo-stp_10.42.42.5(pid=766): stderr: | 20221209061111847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061111848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061111848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061111848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061111849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061111849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061111849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:13.270220 run osmo-stp_10.42.42.5(pid=766): stdout: | (launched: 2022-12-09_06:11:11.681337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:13.393304 run osmo-stp_10.42.42.5(pid=766): stderr: | 20221209061111847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061111848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061111848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061111848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061111849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061111849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061111849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:13.538723 run patchelf(pid=769): Terminating (SIGINT) 06:11:13.706125 run patchelf(pid=769): Terminated: ok {rc=0} 06:11:13.827007 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=766): Process ended prematurely: osmo-stp_10.42.42.5(pid=766) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=766)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:11:13.836670 tst iperf3m4.py:8: Test FAILED (10.2 sec) 06:11:13.865180 run osmo-hlr_10.42.42.2(pid=763): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=763)] 06:11:13.913880 run osmo-hlr_10.42.42.2(pid=763): stdout: | (launched: 2022-12-09_06:11:10.762922) 06:11:13.964026 run osmo-hlr_10.42.42.2(pid=763): stderr: | 20221209061110938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061110938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061110938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061110938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061110938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061110938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061110950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061110958 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061110959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061110959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:14.014539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=752): Terminating (SIGTERM) 06:11:14.055238 run iperf3-srv_10.42.42.10(pid=753): Terminating (SIGTERM) 06:11:14.095487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=754): Terminating (SIGTERM) 06:11:14.135817 run iperf3-srv_10.42.42.10(pid=755): Terminating (SIGTERM) 06:11:14.176068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=756): Terminating (SIGTERM) 06:11:14.216428 run iperf3-srv_10.42.42.10(pid=757): Terminating (SIGTERM) 06:11:14.256624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=758): Terminating (SIGTERM) 06:11:14.297017 run iperf3-srv_10.42.42.10(pid=759): Terminating (SIGTERM) 06:11:14.337284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=762): Terminating (SIGTERM) 06:11:14.377815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=765): Terminating (SIGTERM) 06:11:14.418275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=768): Terminating (SIGTERM) 06:11:14.458924 --- ParallelTerminationStrategy: PID 752 died... 06:11:14.478351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=752): Terminated: ok {rc=0} 06:11:14.523278 --- ParallelTerminationStrategy: PID 753 died... 06:11:14.542053 run iperf3-srv_10.42.42.10(pid=753): Terminated {rc=256} 06:11:14.586546 --- ParallelTerminationStrategy: PID 754 died... 06:11:14.605246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=754): Terminated: ok {rc=0} 06:11:14.649759 --- ParallelTerminationStrategy: PID 755 died... 06:11:14.668379 run iperf3-srv_10.42.42.10(pid=755): Terminated {rc=256} 06:11:14.712845 --- ParallelTerminationStrategy: PID 756 died... 06:11:14.731915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=756): Terminated: ok {rc=0} 06:11:14.776500 --- ParallelTerminationStrategy: PID 757 died... 06:11:14.795353 run iperf3-srv_10.42.42.10(pid=757): Terminated {rc=256} 06:11:14.840087 --- ParallelTerminationStrategy: PID 758 died... 06:11:14.858883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=758): Terminated: ok {rc=0} 06:11:14.903522 --- ParallelTerminationStrategy: PID 759 died... 06:11:14.922429 run iperf3-srv_10.42.42.10(pid=759): Terminated {rc=256} 06:11:14.967474 --- ParallelTerminationStrategy: PID 762 died... 06:11:14.986234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=762): Terminated: ok {rc=0} 06:11:15.030960 --- ParallelTerminationStrategy: PID 765 died... 06:11:15.049741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=765): Terminated: ok {rc=0} 06:11:15.094919 --- ParallelTerminationStrategy: PID 768 died... 06:11:15.113705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=768): Terminated: ok {rc=0} 06:11:15.200557 bus /gobi_4: Setting Powered False 06:11:16.307216 bus /gobi_4: Setting Powered False 06:11:17.439150 bus /gobi_1: Setting Powered False 06:11:18.538081 bus /gobi_1: Setting Powered False 06:11:19.655026 bus /gobi_0: Setting Powered False 06:11:20.755450 bus /gobi_0: Setting Powered False 06:11:21.871433 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:11:22.973337 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:22.984504 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:23.053121 tst ping.py: using LAC 19476 06:11:23.167777 tst ping.py: using RAC 96 06:11:23.280774 tst ping.py: using CellId 19476 06:11:23.399809 tst ping.py: using BVCI 19477 06:11:23.505408 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.516199 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.526981 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.537847 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.548527 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.559414 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.570444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:23.581340 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:23.696682 tst ping.py:19: start network... 06:11:23.904069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:24.385062 run create_hlr_db(pid=770): Launched 06:11:24.510510 bus /gobi_6: Setting Powered False 06:11:25.572290 run create_hlr_db(pid=770): Terminated: ok {rc=0} 06:11:26.005632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=772): Launched 06:11:26.316029 run osmo-hlr_10.42.42.2(pid=773): Launched 06:11:26.433298 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:26.964412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=775): Launched 06:11:27.272628 run osmo-stp_10.42.42.5(pid=776): Launched 06:11:27.390380 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:27.925279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=778): Launched 06:11:28.044680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:28.306209 run patchelf(pid=779): Launched 06:11:28.478534 run osmo-stp_10.42.42.5(pid=776): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=776)] 06:11:28.610454 run osmo-stp_10.42.42.5(pid=776): stdout: | (launched: 2022-12-09_06:11:27.216866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:28.744168 run osmo-stp_10.42.42.5(pid=776): stderr: | 20221209061127406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061127406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061127406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061127407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061127409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061127409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061127409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:28.878011 run osmo-stp_10.42.42.5(pid=776): stdout: | (launched: 2022-12-09_06:11:27.216866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:29.005733 run osmo-stp_10.42.42.5(pid=776): stderr: | 20221209061127406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061127406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061127406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061127407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061127409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061127409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061127409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:29.156772 run patchelf(pid=779): Terminating (SIGINT) 06:11:29.331846 run patchelf(pid=779): Terminated: ok {rc=0} 06:11:29.457360 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=776): Process ended prematurely: osmo-stp_10.42.42.5(pid=776) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=776)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 06:11:29.466572 tst ping.py:22: Test FAILED (6.5 sec) 06:11:29.494281 run osmo-hlr_10.42.42.2(pid=773): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=773)] 06:11:29.544046 run osmo-hlr_10.42.42.2(pid=773): stdout: | (launched: 2022-12-09_06:11:26.258703) 06:11:29.595346 run osmo-hlr_10.42.42.2(pid=773): stderr: | 20221209061126457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061126457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061126457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061126458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061126458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061126458 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061126472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061126482 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061126483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061126483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:29.647040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=772): Terminating (SIGTERM) 06:11:29.688841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=775): Terminating (SIGTERM) 06:11:29.730765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=778): Terminating (SIGTERM) 06:11:29.773071 --- ParallelTerminationStrategy: PID 772 died... 06:11:29.793175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=772): Terminated: ok {rc=0} 06:11:29.839850 --- ParallelTerminationStrategy: PID 775 died... 06:11:29.859563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=775): Terminated: ok {rc=0} 06:11:29.906016 --- ParallelTerminationStrategy: PID 778 died... 06:11:29.925694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=778): Terminated: ok {rc=0} 06:11:30.014567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:11:31.102835 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.116198 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:11:31.189781 tst ping_idle_ping.py: using LAC 19477 06:11:31.327371 tst ping_idle_ping.py: using RAC 97 06:11:31.486532 tst ping_idle_ping.py: using CellId 19477 06:11:31.605183 tst ping_idle_ping.py: using BVCI 19478 06:11:31.722786 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.734766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.746411 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.758238 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.769766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.781457 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.793107 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:11:31.804669 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:11:31.924695 tst ping_idle_ping.py:24: start network... 06:11:32.154404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:32.606604 run create_hlr_db(pid=780): Launched 06:11:32.717385 bus /gobi_6: Setting Powered False 06:11:33.775841 run create_hlr_db(pid=780): Terminated: ok {rc=0} 06:11:34.182353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=782): Launched 06:11:34.471744 run osmo-hlr_10.42.42.2(pid=783): Launched 06:11:34.582097 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:35.078701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=785): Launched 06:11:35.369084 run osmo-stp_10.42.42.5(pid=786): Launched 06:11:35.479982 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:35.981655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=788): Launched 06:11:36.093118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:36.337159 run patchelf(pid=789): Launched 06:11:36.499258 run osmo-stp_10.42.42.5(pid=786): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=786)] 06:11:36.623485 run osmo-stp_10.42.42.5(pid=786): stdout: | (launched: 2022-12-09_06:11:35.316261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:36.749195 run osmo-stp_10.42.42.5(pid=786): stderr: | 20221209061135483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061135484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061135484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061135484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061135485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061135485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061135485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:36.874835 run osmo-stp_10.42.42.5(pid=786): stdout: | (launched: 2022-12-09_06:11:35.316261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:36.994425 run osmo-stp_10.42.42.5(pid=786): stderr: | 20221209061135483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061135484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061135484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061135484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061135485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061135485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061135485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:37.136356 run patchelf(pid=789): Terminating (SIGINT) 06:11:37.300903 run patchelf(pid=789): Terminated: ok {rc=0} 06:11:37.419116 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=786): Process ended prematurely: osmo-stp_10.42.42.5(pid=786) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=786)] [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:11:37.427697 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:11:37.454724 run osmo-hlr_10.42.42.2(pid=783): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=783)] 06:11:37.502846 run osmo-hlr_10.42.42.2(pid=783): stdout: | (launched: 2022-12-09_06:11:34.419081) 06:11:37.552603 run osmo-hlr_10.42.42.2(pid=783): stderr: | 20221209061134594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061134594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061134594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061134594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061134594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061134594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061134607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061134615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061134615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061134615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:37.602971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=782): Terminating (SIGTERM) 06:11:37.643382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=785): Terminating (SIGTERM) 06:11:37.683628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=788): Terminating (SIGTERM) 06:11:37.724652 --- ParallelTerminationStrategy: PID 782 died... 06:11:37.743826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=782): Terminated: ok {rc=0} 06:11:37.788943 --- ParallelTerminationStrategy: PID 785 died... 06:11:37.807902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=785): Terminated: ok {rc=0} 06:11:37.852466 --- ParallelTerminationStrategy: PID 788 died... 06:11:37.871149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=788): Terminated: ok {rc=0} 06:11:37.958124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:11:39.255451 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:11:39.262088 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:11:39.295386 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:11:39.333263 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:11:39.417885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:11:39.449605 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:11:39.487380 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:11:40.091285 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:11:40.139214 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.150326 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:40.201446 tst cs_paging_gprs_active.py: using LAC 19478 06:11:40.326097 tst cs_paging_gprs_active.py: using RAC 98 06:11:40.462715 tst cs_paging_gprs_active.py: using CellId 19478 06:11:40.589404 tst cs_paging_gprs_active.py: using BVCI 19479 06:11:40.705261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.716831 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.728421 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.740674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.753370 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.764666 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.776589 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.788517 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:40.800538 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:40.918162 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:41.034665 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:11:41.233694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:41.531047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Launched 06:11:41.787331 run iperf3-srv_10.42.42.10(pid=794): Launched 06:11:41.898320 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:11:42.095337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:42.391881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Launched 06:11:42.648623 run iperf3-srv_10.42.42.10(pid=796): Launched 06:11:42.759407 tst cs_paging_gprs_active.py:38: start network... 06:11:42.956344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:43.416262 run create_hlr_db(pid=797): Launched 06:11:43.529735 bus /gobi_6: Setting Powered False 06:11:44.589064 run create_hlr_db(pid=797): Terminated: ok {rc=0} 06:11:45.022547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Launched 06:11:45.339744 run osmo-hlr_10.42.42.2(pid=800): Launched 06:11:45.460523 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:46.040520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Launched 06:11:46.381660 run osmo-stp_10.42.42.5(pid=803): Launched 06:11:46.654927 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:47.210228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Launched 06:11:47.332070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:47.598928 run patchelf(pid=806): Launched 06:11:47.774924 run osmo-stp_10.42.42.5(pid=803): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=803)] 06:11:47.909440 run osmo-stp_10.42.42.5(pid=803): stdout: | (launched: 2022-12-09_06:11:46.309714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:48.045255 run osmo-stp_10.42.42.5(pid=803): stderr: | 20221209061146551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061146551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061146551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061146551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061146552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061146552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061146552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:48.182041 run osmo-stp_10.42.42.5(pid=803): stdout: | (launched: 2022-12-09_06:11:46.309714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:48.312727 run osmo-stp_10.42.42.5(pid=803): stderr: | 20221209061146551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061146551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061146551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061146551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061146552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061146552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061146552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:11:48.466977 run patchelf(pid=806): Terminating (SIGINT) 06:11:48.644133 run patchelf(pid=806): Terminated: ok {rc=0} 06:11:48.772138 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=803): Process ended prematurely: osmo-stp_10.42.42.5(pid=803) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=803)] [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:11:48.782155 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 06:11:48.810542 run osmo-hlr_10.42.42.2(pid=800): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=800)] 06:11:48.860610 run osmo-hlr_10.42.42.2(pid=800): stdout: | (launched: 2022-12-09_06:11:45.282454) 06:11:48.912430 run osmo-hlr_10.42.42.2(pid=800): stderr: | 20221209061145479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061145479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061145479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061145479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061145479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061145479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061145490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061145498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061145498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061145498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:11:48.964734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Terminating (SIGTERM) 06:11:49.007067 run iperf3-srv_10.42.42.10(pid=794): Terminating (SIGTERM) 06:11:49.049271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminating (SIGTERM) 06:11:49.091393 run iperf3-srv_10.42.42.10(pid=796): Terminating (SIGTERM) 06:11:49.133437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Terminating (SIGTERM) 06:11:49.175513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Terminating (SIGTERM) 06:11:49.217742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Terminating (SIGTERM) 06:11:49.260077 --- ParallelTerminationStrategy: PID 793 died... 06:11:49.280422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=793): Terminated: ok {rc=0} 06:11:49.327018 --- ParallelTerminationStrategy: PID 794 died... 06:11:49.346777 run iperf3-srv_10.42.42.10(pid=794): Terminated {rc=256} 06:11:49.392875 --- ParallelTerminationStrategy: PID 795 died... 06:11:49.412698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminated: ok {rc=0} 06:11:49.458844 --- ParallelTerminationStrategy: PID 796 died... 06:11:49.478221 run iperf3-srv_10.42.42.10(pid=796): Terminated {rc=256} 06:11:49.524285 --- ParallelTerminationStrategy: PID 799 died... 06:11:49.544047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Terminated: ok {rc=0} 06:11:49.590299 --- ParallelTerminationStrategy: PID 802 died... 06:11:49.609946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Terminated: ok {rc=0} 06:11:49.656065 --- ParallelTerminationStrategy: PID 805 died... 06:11:49.675908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Terminated: ok {rc=0} 06:11:49.764353 bus /gobi_0: Setting Powered False 06:11:50.864317 bus /gobi_0: Setting Powered False 06:11:51.981414 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:11:53.126636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.138267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:11:53.195194 tst iperf3.py: using LAC 19479 06:11:53.311293 tst iperf3.py: using RAC 99 06:11:53.426668 tst iperf3.py: using CellId 19479 06:11:53.543324 tst iperf3.py: using BVCI 19480 06:11:53.650899 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.662053 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.672925 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.684175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.695311 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.706484 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.717789 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.728866 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:11:53.740237 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:11:53.860650 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:11:54.074686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:11:54.392527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Launched 06:11:54.667830 run iperf3-srv_10.42.42.10(pid=808): Launched 06:11:54.786792 tst iperf3.py:8: start network... 06:11:54.999825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:11:55.489711 run create_hlr_db(pid=809): Launched 06:11:55.618390 bus /gobi_6: Setting Powered False 06:11:56.680513 run create_hlr_db(pid=809): Terminated: ok {rc=0} 06:11:57.119186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Launched 06:11:57.433969 run osmo-hlr_10.42.42.2(pid=812): Launched 06:11:57.553874 run osmo-stp_10.42.42.5: Starting osmo-stp 06:11:58.101540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Launched 06:11:58.417262 run osmo-stp_10.42.42.5(pid=815): Launched 06:11:58.537066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:11:59.080667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=817): Launched 06:11:59.201273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:11:59.468536 run patchelf(pid=818): Launched 06:11:59.644559 run osmo-stp_10.42.42.5(pid=815): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] 06:11:59.779423 run osmo-stp_10.42.42.5(pid=815): stdout: | (launched: 2022-12-09_06:11:58.360481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:11:59.915738 run osmo-stp_10.42.42.5(pid=815): stderr: | 20221209061158550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061158550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061158551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061158551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061158551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061158552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061158552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:00.052444 run osmo-stp_10.42.42.5(pid=815): stdout: | (launched: 2022-12-09_06:11:58.360481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:00.183605 run osmo-stp_10.42.42.5(pid=815): stderr: | 20221209061158550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061158550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061158551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061158551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061158551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061158552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061158552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:00.340380 run patchelf(pid=818): Terminating (SIGINT) 06:12:00.519281 run patchelf(pid=818): Terminated: ok {rc=0} 06:12:00.647987 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=815): Process ended prematurely: osmo-stp_10.42.42.5(pid=815) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:12:00.658152 tst iperf3.py:8: Test FAILED (7.6 sec) 06:12:00.686472 run osmo-hlr_10.42.42.2(pid=812): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=812)] 06:12:00.736743 run osmo-hlr_10.42.42.2(pid=812): stdout: | (launched: 2022-12-09_06:11:57.377337) 06:12:00.788779 run osmo-hlr_10.42.42.2(pid=812): stderr: | 20221209061157576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061157577 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061157577 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061157577 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061157577 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061157577 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061157590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061157599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061157599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061157599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:00.841377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Terminating (SIGTERM) 06:12:00.884521 run iperf3-srv_10.42.42.10(pid=808): Terminating (SIGTERM) 06:12:00.927458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Terminating (SIGTERM) 06:12:00.970261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Terminating (SIGTERM) 06:12:01.013837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=817): Terminating (SIGTERM) 06:12:01.058731 --- ParallelTerminationStrategy: PID 807 died... 06:12:01.079302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Terminated: ok {rc=0} 06:12:01.127059 --- ParallelTerminationStrategy: PID 808 died... 06:12:01.147062 run iperf3-srv_10.42.42.10(pid=808): Terminated {rc=256} 06:12:01.194408 --- ParallelTerminationStrategy: PID 811 died... 06:12:01.214481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=811): Terminated: ok {rc=0} 06:12:01.261509 --- ParallelTerminationStrategy: PID 814 died... 06:12:01.281595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=814): Terminated: ok {rc=0} 06:12:01.329318 --- ParallelTerminationStrategy: PID 817 died... 06:12:01.349476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=817): Terminated: ok {rc=0} 06:12:01.439274 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:12:02.584364 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:02.599477 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:02.654356 tst iperf3m4.py: using LAC 19480 06:12:02.770732 tst iperf3m4.py: using RAC 100 06:12:02.885584 tst iperf3m4.py: using CellId 19480 06:12:03.004725 tst iperf3m4.py: using BVCI 19481 06:12:03.112473 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.123760 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.134700 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.146464 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.158185 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.169814 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.181734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.193391 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:03.205261 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:03.321211 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:03.439122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:03.554440 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:03.672086 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:12:03.870257 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:04.166233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=820): Launched 06:12:04.424186 run iperf3-srv_10.42.42.10(pid=821): Launched 06:12:04.535067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:12:04.732350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:05.028517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=822): Launched 06:12:05.286833 run iperf3-srv_10.42.42.10(pid=824): Launched 06:12:05.397669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:12:05.595113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:05.890833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Launched 06:12:06.147658 run iperf3-srv_10.42.42.10(pid=826): Launched 06:12:06.258725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:12:06.456087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:12:06.752179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Launched 06:12:07.008708 run iperf3-srv_10.42.42.10(pid=828): Launched 06:12:07.119330 tst iperf3m4.py:8: start network... 06:12:07.316271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:07.772905 run create_hlr_db(pid=831): Launched 06:12:07.886293 bus /gobi_6: Setting Powered False 06:12:08.945992 run create_hlr_db(pid=831): Terminated: ok {rc=0} 06:12:09.359405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Launched 06:12:09.653677 run osmo-hlr_10.42.42.2(pid=835): Launched 06:12:09.766173 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:10.286771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Launched 06:12:10.580894 run osmo-stp_10.42.42.5(pid=838): Launched 06:12:10.693438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:11.200718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Launched 06:12:11.314243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:11.563599 run patchelf(pid=841): Launched 06:12:11.728422 run osmo-stp_10.42.42.5(pid=838): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] 06:12:11.854379 run osmo-stp_10.42.42.5(pid=838): stdout: | (launched: 2022-12-09_06:12:10.527430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:11.981419 run osmo-stp_10.42.42.5(pid=838): stderr: | 20221209061210692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061210692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061210692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061210693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061210693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061210693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061210693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:12.108888 run osmo-stp_10.42.42.5(pid=838): stdout: | (launched: 2022-12-09_06:12:10.527430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:12.231503 run osmo-stp_10.42.42.5(pid=838): stderr: | 20221209061210692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061210692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061210692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061210693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061210693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061210693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061210693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:12.376886 run patchelf(pid=841): Terminating (SIGINT) 06:12:12.543209 run patchelf(pid=841): Terminated: ok {rc=0} 06:12:12.663362 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=838): Process ended prematurely: osmo-stp_10.42.42.5(pid=838) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:12:12.672686 tst iperf3m4.py:8: Test FAILED (10.1 sec) 06:12:12.700250 run osmo-hlr_10.42.42.2(pid=835): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=835)] 06:12:12.748768 run osmo-hlr_10.42.42.2(pid=835): stdout: | (launched: 2022-12-09_06:12:09.599866) 06:12:12.798849 run osmo-hlr_10.42.42.2(pid=835): stderr: | 20221209061209772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061209773 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061209773 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061209773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061209773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061209773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061209785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061209794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061209794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061209794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:12.849438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=820): Terminating (SIGTERM) 06:12:12.889740 run iperf3-srv_10.42.42.10(pid=821): Terminating (SIGTERM) 06:12:12.930107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=822): Terminating (SIGTERM) 06:12:12.970458 run iperf3-srv_10.42.42.10(pid=824): Terminating (SIGTERM) 06:12:13.010468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Terminating (SIGTERM) 06:12:13.050896 run iperf3-srv_10.42.42.10(pid=826): Terminating (SIGTERM) 06:12:13.090921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Terminating (SIGTERM) 06:12:13.131233 run iperf3-srv_10.42.42.10(pid=828): Terminating (SIGTERM) 06:12:13.171350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Terminating (SIGTERM) 06:12:13.211445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Terminating (SIGTERM) 06:12:13.251644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Terminating (SIGTERM) 06:12:13.292006 --- ParallelTerminationStrategy: PID 820 died... 06:12:13.311169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=820): Terminated: ok {rc=0} 06:12:13.355737 --- ParallelTerminationStrategy: PID 821 died... 06:12:13.374361 run iperf3-srv_10.42.42.10(pid=821): Terminated {rc=256} 06:12:13.418784 --- ParallelTerminationStrategy: PID 822 died... 06:12:13.437334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=822): Terminated: ok {rc=0} 06:12:13.481958 --- ParallelTerminationStrategy: PID 824 died... 06:12:13.500485 run iperf3-srv_10.42.42.10(pid=824): Terminated {rc=256} 06:12:13.545426 --- ParallelTerminationStrategy: PID 825 died... 06:12:13.564094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Terminated: ok {rc=0} 06:12:13.608624 --- ParallelTerminationStrategy: PID 826 died... 06:12:13.627219 run iperf3-srv_10.42.42.10(pid=826): Terminated {rc=256} 06:12:13.671359 --- ParallelTerminationStrategy: PID 827 died... 06:12:13.689865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Terminated: ok {rc=0} 06:12:13.734306 --- ParallelTerminationStrategy: PID 828 died... 06:12:13.753291 run iperf3-srv_10.42.42.10(pid=828): Terminated {rc=256} 06:12:13.797736 --- ParallelTerminationStrategy: PID 834 died... 06:12:13.816509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Terminated: ok {rc=0} 06:12:13.861115 --- ParallelTerminationStrategy: PID 837 died... 06:12:13.879712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Terminated: ok {rc=0} 06:12:13.924209 --- ParallelTerminationStrategy: PID 840 died... 06:12:13.943097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Terminated: ok {rc=0} 06:12:14.027140 bus /gobi_4: Setting Powered False 06:12:15.127669 bus /gobi_4: Setting Powered False 06:12:16.253962 bus /gobi_1: Setting Powered False 06:12:17.352317 bus /gobi_1: Setting Powered False 06:12:18.468872 bus /gobi_0: Setting Powered False 06:12:19.567896 bus /gobi_0: Setting Powered False 06:12:20.685377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:12:21.789797 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:21.802021 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:21.855297 tst ping.py: using LAC 19481 06:12:21.977954 tst ping.py: using RAC 101 06:12:22.099150 tst ping.py: using CellId 19481 06:12:22.221081 tst ping.py: using BVCI 19482 06:12:22.333972 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.345674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.357316 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.368858 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.380461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.392024 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.403673 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:22.415171 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:22.531800 tst ping.py:19: start network... 06:12:22.740340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:23.218631 run create_hlr_db(pid=842): Launched 06:12:23.344234 bus /gobi_6: Setting Powered False 06:12:24.405799 run create_hlr_db(pid=842): Terminated: ok {rc=0} 06:12:24.821055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Launched 06:12:25.111064 run osmo-hlr_10.42.42.2(pid=846): Launched 06:12:25.221415 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:25.723909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Launched 06:12:26.012604 run osmo-stp_10.42.42.5(pid=849): Launched 06:12:26.122744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:26.622541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=851): Launched 06:12:26.733721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:26.978347 run patchelf(pid=852): Launched 06:12:27.140183 run osmo-stp_10.42.42.5(pid=849): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] 06:12:27.264144 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-09_06:12:25.960015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:27.389522 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221209061226128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061226128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061226128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061226129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061226129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061226129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061226129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:27.515103 run osmo-stp_10.42.42.5(pid=849): stdout: | (launched: 2022-12-09_06:12:25.960015) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:27.634729 run osmo-stp_10.42.42.5(pid=849): stderr: | 20221209061226128 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061226128 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061226128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061226129 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061226129 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061226129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061226129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:27.776518 run patchelf(pid=852): Terminating (SIGINT) 06:12:27.940707 run patchelf(pid=852): Terminated: ok {rc=0} 06:12:28.058966 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:12:28.067689 tst ping.py:22: Test FAILED (6.3 sec) 06:12:28.095183 run osmo-hlr_10.42.42.2(pid=846): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=846)] 06:12:28.143454 run osmo-hlr_10.42.42.2(pid=846): stdout: | (launched: 2022-12-09_06:12:25.057660) 06:12:28.193578 run osmo-hlr_10.42.42.2(pid=846): stderr: | 20221209061225232 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061225232 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061225232 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061225232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061225232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061225232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061225244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061225254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061225254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061225254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:28.243841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminating (SIGTERM) 06:12:28.284360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminating (SIGTERM) 06:12:28.324674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=851): Terminating (SIGTERM) 06:12:28.365245 --- ParallelTerminationStrategy: PID 845 died... 06:12:28.384363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=845): Terminated: ok {rc=0} 06:12:28.429431 --- ParallelTerminationStrategy: PID 848 died... 06:12:28.448332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=848): Terminated: ok {rc=0} 06:12:28.493366 --- ParallelTerminationStrategy: PID 851 died... 06:12:28.512012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=851): Terminated: ok {rc=0} 06:12:28.595951 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:12:29.682522 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:29.695241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:12:29.751342 tst ping_idle_ping.py: using LAC 19482 06:12:29.875816 tst ping_idle_ping.py: using RAC 102 06:12:29.998652 tst ping_idle_ping.py: using CellId 19482 06:12:30.122799 tst ping_idle_ping.py: using BVCI 19483 06:12:30.236028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.247742 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.259241 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.271820 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.283239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.295076 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.307601 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:12:30.319806 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:12:30.439795 tst ping_idle_ping.py:24: start network... 06:12:30.637242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:31.128873 run create_hlr_db(pid=853): Launched 06:12:31.266703 bus /gobi_6: Setting Powered False 06:12:32.329851 run create_hlr_db(pid=853): Terminated: ok {rc=0} 06:12:32.766831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=855): Launched 06:12:33.077148 run osmo-hlr_10.42.42.2(pid=856): Launched 06:12:33.194516 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:33.732384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=858): Launched 06:12:34.042191 run osmo-stp_10.42.42.5(pid=859): Launched 06:12:34.160419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:34.696738 run pcap-recorder_any(filters='host 10.42.42.6')(pid=861): Launched 06:12:34.816187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:35.079243 run patchelf(pid=862): Launched 06:12:35.253508 run osmo-stp_10.42.42.5(pid=859): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=859)] 06:12:35.387100 run osmo-stp_10.42.42.5(pid=859): stdout: | (launched: 2022-12-09_06:12:33.986177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:35.521726 run osmo-stp_10.42.42.5(pid=859): stderr: | 20221209061234175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061234175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061234175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061234175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061234176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061234176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061234176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:35.656492 run osmo-stp_10.42.42.5(pid=859): stdout: | (launched: 2022-12-09_06:12:33.986177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:35.786807 run osmo-stp_10.42.42.5(pid=859): stderr: | 20221209061234175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061234175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061234175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061234175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061234176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061234176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061234176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:35.940176 run patchelf(pid=862): Terminating (SIGINT) 06:12:36.115736 run patchelf(pid=862): Terminated: ok {rc=0} 06:12:36.242212 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=859): Process ended prematurely: osmo-stp_10.42.42.5(pid=859) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=859)] [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:12:36.251807 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:12:36.279858 run osmo-hlr_10.42.42.2(pid=856): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=856)] 06:12:36.330983 run osmo-hlr_10.42.42.2(pid=856): stdout: | (launched: 2022-12-09_06:12:33.021154) 06:12:36.383364 run osmo-hlr_10.42.42.2(pid=856): stderr: | 20221209061233220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061233220 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061233220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061233220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061233220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061233220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061233233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061233241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061233241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061233241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:36.436074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=855): Terminating (SIGTERM) 06:12:36.478485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=858): Terminating (SIGTERM) 06:12:36.521012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=861): Terminating (SIGTERM) 06:12:36.563652 --- ParallelTerminationStrategy: PID 855 died... 06:12:36.583374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=855): Terminated: ok {rc=0} 06:12:36.629939 --- ParallelTerminationStrategy: PID 858 died... 06:12:36.649617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=858): Terminated: ok {rc=0} 06:12:36.696110 --- ParallelTerminationStrategy: PID 861 died... 06:12:36.715938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=861): Terminated: ok {rc=0} 06:12:36.804720 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:12:38.117114 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:38.124480 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:12:38.157768 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:12:38.192494 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:12:38.246865 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:12:38.280588 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:12:38.315562 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:12:38.877801 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:12:38.883860 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:38.895940 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:12:38.965392 tst switch_tch_pdch.py: using LAC 19483 06:12:39.088468 tst switch_tch_pdch.py: using RAC 103 06:12:39.211479 tst switch_tch_pdch.py: using CellId 19483 06:12:39.333037 tst switch_tch_pdch.py: using BVCI 19484 06:12:39.445225 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.456669 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.468042 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.479352 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.490592 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.501845 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.513384 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:12:39.524640 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:12:39.638567 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:12:39.751756 tst switch_tch_pdch.py:51: start network... 06:12:39.945504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:40.394509 run create_hlr_db(pid=868): Launched 06:12:40.504725 bus /gobi_6: Setting Powered False 06:12:41.562992 run create_hlr_db(pid=868): Terminated: ok {rc=0} 06:12:41.986433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Launched 06:12:42.293492 run osmo-hlr_10.42.42.2(pid=871): Launched 06:12:42.411827 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:42.948038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Launched 06:12:43.255935 run osmo-stp_10.42.42.5(pid=888): Launched 06:12:43.374547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:43.908198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=890): Launched 06:12:44.027062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:44.288091 run patchelf(pid=891): Launched 06:12:44.460898 run osmo-stp_10.42.42.5(pid=888): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] 06:12:44.593166 run osmo-stp_10.42.42.5(pid=888): stdout: | (launched: 2022-12-09_06:12:43.200263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:44.726408 run osmo-stp_10.42.42.5(pid=888): stderr: | 20221209061243390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061243390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061243390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061243391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061243391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061243391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061243391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:44.859763 run osmo-stp_10.42.42.5(pid=888): stdout: | (launched: 2022-12-09_06:12:43.200263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:44.986911 run osmo-stp_10.42.42.5(pid=888): stderr: | 20221209061243390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061243390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061243390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061243391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061243391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061243391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061243391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:45.137406 run patchelf(pid=891): Terminating (SIGINT) 06:12:45.311450 run patchelf(pid=891): Terminated: ok {rc=0} 06:12:45.437564 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=888): Process ended prematurely: osmo-stp_10.42.42.5(pid=888) [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:12:45.446888 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 06:12:45.474331 run osmo-hlr_10.42.42.2(pid=871): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=871)] 06:12:45.524283 run osmo-hlr_10.42.42.2(pid=871): stdout: | (launched: 2022-12-09_06:12:42.237954) 06:12:45.576164 run osmo-hlr_10.42.42.2(pid=871): stderr: | 20221209061242433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061242433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061242433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061242433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061242433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061242433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061242446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061242454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061242454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061242454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:45.628303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminating (SIGTERM) 06:12:45.670131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminating (SIGTERM) 06:12:45.712062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=890): Terminating (SIGTERM) 06:12:45.754211 --- ParallelTerminationStrategy: PID 870 died... 06:12:45.774133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=870): Terminated: ok {rc=0} 06:12:45.820422 --- ParallelTerminationStrategy: PID 887 died... 06:12:45.839998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=887): Terminated: ok {rc=0} 06:12:45.899232 --- ParallelTerminationStrategy: PID 890 died... 06:12:45.919194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=890): Terminated: ok {rc=0} 06:12:46.008859 bus /gobi_0: Setting Powered False 06:12:47.104839 bus /gobi_0: Setting Powered False 06:12:48.220855 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:12:49.474354 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:12:49.480216 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:12:49.512933 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:12:49.547974 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:12:49.601436 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:12:49.634138 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:12:49.668830 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:12:50.225194 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:12:50.230375 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.241535 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:12:50.313886 tst switch_tch_pdch.py: using LAC 19484 06:12:50.434270 tst switch_tch_pdch.py: using RAC 104 06:12:50.552626 tst switch_tch_pdch.py: using CellId 19484 06:12:50.671623 tst switch_tch_pdch.py: using BVCI 19485 06:12:50.778861 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.789924 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.800615 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.811920 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.823098 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.834524 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.845962 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:12:50.857221 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:12:50.973466 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:12:51.087017 tst switch_tch_pdch.py:51: start network... 06:12:51.280359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:12:51.703469 run create_hlr_db(pid=895): Launched 06:12:51.813172 bus /gobi_6: Setting Powered False 06:12:52.874117 run create_hlr_db(pid=895): Terminated: ok {rc=0} 06:12:53.279965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=897): Launched 06:12:53.588831 run osmo-hlr_10.42.42.2(pid=898): Launched 06:12:53.707058 run osmo-stp_10.42.42.5: Starting osmo-stp 06:12:54.212577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=900): Launched 06:12:54.521115 run osmo-stp_10.42.42.5(pid=901): Launched 06:12:54.639163 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:12:55.145945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=903): Launched 06:12:55.264446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:12:55.525324 run patchelf(pid=904): Launched 06:12:55.697851 run osmo-stp_10.42.42.5(pid=901): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=901)] 06:12:55.830060 run osmo-stp_10.42.42.5(pid=901): stdout: | (launched: 2022-12-09_06:12:54.465611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:55.963462 run osmo-stp_10.42.42.5(pid=901): stderr: | 20221209061254653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061254653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061254653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061254654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061254656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061254656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061254656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:56.097277 run osmo-stp_10.42.42.5(pid=901): stdout: | (launched: 2022-12-09_06:12:54.465611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:12:56.224402 run osmo-stp_10.42.42.5(pid=901): stderr: | 20221209061254653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061254653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061254653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061254654 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061254656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061254656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061254656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:12:56.376103 run patchelf(pid=904): Terminating (SIGINT) 06:12:56.550270 run patchelf(pid=904): Terminated: ok {rc=0} 06:12:56.676179 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=901): Process ended prematurely: osmo-stp_10.42.42.5(pid=901) [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=901)] [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:12:56.685603 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 06:12:56.713270 run osmo-hlr_10.42.42.2(pid=898): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=898)] 06:12:56.763514 run osmo-hlr_10.42.42.2(pid=898): stdout: | (launched: 2022-12-09_06:12:53.533172) 06:12:56.815668 run osmo-hlr_10.42.42.2(pid=898): stderr: | 20221209061253727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061253727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061253727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061253727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061253727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061253727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061253739 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061253748 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061253748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061253748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:12:56.868066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=897): Terminating (SIGTERM) 06:12:56.910208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=900): Terminating (SIGTERM) 06:12:56.952398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=903): Terminating (SIGTERM) 06:12:56.994877 --- ParallelTerminationStrategy: PID 897 died... 06:12:57.014934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=897): Terminated: ok {rc=0} 06:12:57.061471 --- ParallelTerminationStrategy: PID 900 died... 06:12:57.080992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=900): Terminated: ok {rc=0} 06:12:57.127458 --- ParallelTerminationStrategy: PID 903 died... 06:12:57.147249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=903): Terminated: ok {rc=0} 06:12:57.234467 bus /gobi_0: Setting Powered False 06:12:58.332890 bus /gobi_0: Setting Powered False 06:12:59.450044 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:trx-lms --------------------------------------------------------------------- 06:13:00.694429 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:00.698379 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:13:00.731495 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:13:00.738107 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:13:00.789162 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:13:00.822147 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:13:00.828649 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:13:01.371762 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:13:01.376596 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 06:13:01.388354 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 06:13:01.438284 tst mo_mt_sms.py: using LAC 19485 06:13:01.556736 tst mo_mt_sms.py: using RAC 105 06:13:01.691445 tst mo_mt_sms.py: using CellId 19485 06:13:01.838361 tst mo_mt_sms.py: using BVCI 19486 06:13:01.953859 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:02.073552 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:02.191860 tst mo_mt_sms.py:9: start nitb and bts... 06:13:02.406872 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:13:03.038689 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=908): Launched 06:13:03.346951 run osmo-nitb_10.42.42.2(pid=909): Launched 06:13:03.518042 run osmo-nitb_10.42.42.2(pid=909): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=909)] 06:13:03.657802 run osmo-nitb_10.42.42.2(pid=909): stdout: | (launched: 2022-12-09_06:13:03.290789) 06:13:03.799255 run osmo-nitb_10.42.42.2(pid=909): stderr: | (launched: 2022-12-09_06:13:03.337194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:03.940454 run osmo-nitb_10.42.42.2(pid=909): stdout: | (launched: 2022-12-09_06:13:03.290789) 06:13:04.075577 run osmo-nitb_10.42.42.2(pid=909): stderr: | (launched: 2022-12-09_06:13:03.337194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=909) [trial-2355↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=909)] 06:13:04.463592 tst osmo-nitb_10.42.42.2(pid=909): stdout: | (launched: 2022-12-09_06:13:03.290789) 06:13:04.588584 tst osmo-nitb_10.42.42.2(pid=909): stderr: | (launched: 2022-12-09_06:13:03.337194) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:04.736471 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=909) [trial-2355↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=909)] [trial-2355↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 06:13:04.745509 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 06:13:04.752649 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=908): Terminating (SIGTERM) 06:13:04.963053 --- ParallelTerminationStrategy: PID 908 died... 06:13:04.984482 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=908): Terminated: ok {rc=0} 06:13:05.072168 bus /sierra_3: Setting Powered False 06:13:06.171596 bus /sierra_3: Setting Powered False 06:13:07.290040 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:trx-lms --------------------------------------------------------------------- 06:13:08.486769 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:08.490887 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 06:13:08.524065 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:13:08.551036 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 06:13:08.603842 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 06:13:08.637145 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:13:08.663946 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 06:13:09.206082 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 06:13:09.211301 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.221901 tst sms:trx-lms: Using 1 x bts (candidates: 1) 06:13:09.267977 tst mo_mt_sms.py: using LAC 19486 06:13:09.382694 tst mo_mt_sms.py: using RAC 106 06:13:09.504175 tst mo_mt_sms.py: using CellId 19486 06:13:09.625177 tst mo_mt_sms.py: using BVCI 19487 06:13:09.736452 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.747295 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.758459 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.769133 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.779781 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:09.790387 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:09.902050 tst sms:trx-lms: Using 1 x modem (candidates: 2) 06:13:10.021758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:10.468848 run create_hlr_db(pid=914): Launched 06:13:10.581603 bus /sierra_2: Setting Powered False 06:13:11.639888 run create_hlr_db(pid=914): Terminated: ok {rc=0} 06:13:12.063156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Launched 06:13:12.372130 run osmo-hlr_10.42.42.2(pid=917): Launched 06:13:12.489783 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:13.025624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Launched 06:13:13.333248 run osmo-stp_10.42.42.5(pid=920): Launched 06:13:13.450728 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:14.010465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=922): Launched 06:13:14.319340 run osmo-msc_10.42.42.6(pid=923): Launched 06:13:14.492761 run osmo-stp_10.42.42.5(pid=920): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=920)] 06:13:14.624141 run osmo-stp_10.42.42.5(pid=920): stdout: | (launched: 2022-12-09_06:13:13.277513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:14.755268 run osmo-stp_10.42.42.5(pid=920): stderr: | 20221209061313467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061313467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061313467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061313468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061313468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061313468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061313468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:14.886970 run osmo-stp_10.42.42.5(pid=920): stdout: | (launched: 2022-12-09_06:13:13.277513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:15.010361 run osmo-stp_10.42.42.5(pid=920): stderr: | 20221209061313467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061313467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061313467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061313468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061313468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061313468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061313468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:15.157897 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=920): Process ended prematurely: osmo-stp_10.42.42.5(pid=920) [trial-2355↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=920)] [trial-2355↪sms:trx-lms↪mo_mt_sms.py:16] 06:13:15.166509 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 06:13:15.193459 run osmo-hlr_10.42.42.2(pid=917): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=917)] 06:13:15.243216 run osmo-hlr_10.42.42.2(pid=917): stdout: | (launched: 2022-12-09_06:13:12.315924) 06:13:15.294644 run osmo-hlr_10.42.42.2(pid=917): stderr: | 20221209061312509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061312509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061312509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061312509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061312509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061312509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061312521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061312529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061312529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061312530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:15.366716 run osmo-msc_10.42.42.6(pid=923): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=923)] 06:13:15.416292 run osmo-msc_10.42.42.6(pid=923): stdout: | (launched: 2022-12-09_06:13:14.263463) 06:13:15.467407 run osmo-msc_10.42.42.6(pid=923): stderr: | 20221209061314585 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061314585 DLGLOBAL DEBUG validating counter group 0x7f1d2731cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061314586 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061314586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061314586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061314586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061314588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061314588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061314588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061314588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:15.518995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Terminating (SIGTERM) 06:13:15.560643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Terminating (SIGTERM) 06:13:15.602370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=922): Terminating (SIGTERM) 06:13:15.644280 --- ParallelTerminationStrategy: PID 916 died... 06:13:15.664125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Terminated: ok {rc=0} 06:13:15.710288 --- ParallelTerminationStrategy: PID 919 died... 06:13:15.730034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Terminated: ok {rc=0} 06:13:15.775761 --- ParallelTerminationStrategy: PID 922 died... 06:13:15.795026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=922): Terminated: ok {rc=0} 06:13:15.883253 bus /sierra_3: Setting Powered False 06:13:16.989275 bus /sierra_3: Setting Powered False 06:13:18.106132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-lms --------------------------------------------------------------------- 06:13:19.330276 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:19.334012 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:13:19.366622 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 06:13:19.373421 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:13:19.408483 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:13:19.441130 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 06:13:19.447772 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:13:19.965573 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 06:13:19.970578 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 06:13:19.981297 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 06:13:20.027601 tst assert_extension.py: using LAC 19487 06:13:20.145994 tst assert_extension.py: using RAC 107 06:13:20.260688 tst assert_extension.py: using CellId 19487 06:13:20.372232 tst assert_extension.py: using BVCI 19488 06:13:20.476467 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 06:13:20.592680 tst assert_extension.py:10: start nitb and bts... 06:13:20.802447 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:13:21.436800 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=928): Launched 06:13:21.744622 run osmo-nitb_10.42.42.2(pid=929): Launched 06:13:21.915441 run osmo-nitb_10.42.42.2(pid=929): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=929)] 06:13:22.054730 run osmo-nitb_10.42.42.2(pid=929): stdout: | (launched: 2022-12-09_06:13:21.689237) 06:13:22.195998 run osmo-nitb_10.42.42.2(pid=929): stderr: | (launched: 2022-12-09_06:13:21.735104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:22.337055 run osmo-nitb_10.42.42.2(pid=929): stdout: | (launched: 2022-12-09_06:13:21.689237) 06:13:22.471847 run osmo-nitb_10.42.42.2(pid=929): stderr: | (launched: 2022-12-09_06:13:21.735104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=929): Process ended prematurely: osmo-nitb_10.42.42.2(pid=929) [trial-2355↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=929)] 06:13:22.860878 tst osmo-nitb_10.42.42.2(pid=929): stdout: | (launched: 2022-12-09_06:13:21.689237) 06:13:22.986137 tst osmo-nitb_10.42.42.2(pid=929): stderr: | (launched: 2022-12-09_06:13:21.735104) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:13:23.133985 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=929): Process ended prematurely: osmo-nitb_10.42.42.2(pid=929) [trial-2355↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=929)] [trial-2355↪nitb_ussd:trx-lms↪assert_extension.py:12] 06:13:23.143003 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:13:23.150201 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=928): Terminating (SIGTERM) 06:13:23.361408 --- ParallelTerminationStrategy: PID 928 died... 06:13:23.382989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=928): Terminated: ok {rc=0} 06:13:23.471558 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:trx-lms --------------------------------------------------------------------- 06:13:24.643867 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:24.647570 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 06:13:24.680406 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:13:24.706673 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 06:13:24.740717 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 06:13:24.773490 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:13:24.799400 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 06:13:25.326847 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:trx-lms assert_extension.py ---------------------------------------------- 06:13:25.331990 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.342588 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 06:13:25.390034 tst assert_extension.py: using LAC 19488 06:13:25.505849 tst assert_extension.py: using RAC 108 06:13:25.621044 tst assert_extension.py: using CellId 19488 06:13:25.742665 tst assert_extension.py: using BVCI 19489 06:13:25.854713 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.865708 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.876541 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.887355 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.898291 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 06:13:25.909304 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 06:13:26.019350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:26.467904 run create_hlr_db(pid=933): Launched 06:13:26.578163 bus /sierra_2: Setting Powered False 06:13:27.636027 run create_hlr_db(pid=933): Terminated: ok {rc=0} 06:13:28.062901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Launched 06:13:28.372002 run osmo-hlr_10.42.42.2(pid=937): Launched 06:13:28.490325 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:29.029152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Launched 06:13:29.338314 run osmo-stp_10.42.42.5(pid=940): Launched 06:13:29.456163 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:30.014949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=942): Launched 06:13:30.323930 run osmo-msc_10.42.42.6(pid=943): Launched 06:13:30.499388 run osmo-stp_10.42.42.5(pid=940): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=940)] 06:13:30.631867 run osmo-stp_10.42.42.5(pid=940): stdout: | (launched: 2022-12-09_06:13:29.282088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:30.763860 run osmo-stp_10.42.42.5(pid=940): stderr: | 20221209061329470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061329471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061329471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061329471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061329474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061329474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061329474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:30.896843 run osmo-stp_10.42.42.5(pid=940): stdout: | (launched: 2022-12-09_06:13:29.282088) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:31.029876 run osmo-stp_10.42.42.5(pid=940): stderr: | 20221209061329470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061329471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061329471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061329471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061329474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061329474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061329474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:31.181406 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=940): Process ended prematurely: osmo-stp_10.42.42.5(pid=940) [trial-2355↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=940)] [trial-2355↪ussd:trx-lms↪assert_extension.py:17] 06:13:31.190709 tst assert_extension.py:17: Test FAILED (5.9 sec) 06:13:31.218772 run osmo-hlr_10.42.42.2(pid=937): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=937)] 06:13:31.270288 run osmo-hlr_10.42.42.2(pid=937): stdout: | (launched: 2022-12-09_06:13:28.315730) 06:13:31.323583 run osmo-hlr_10.42.42.2(pid=937): stderr: | 20221209061328512 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061328512 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061328512 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061328512 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061328513 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061328513 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061328525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061328533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061328533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061328533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:31.397361 run osmo-msc_10.42.42.6(pid=943): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=943)] 06:13:31.448801 run osmo-msc_10.42.42.6(pid=943): stdout: | (launched: 2022-12-09_06:13:30.267876) 06:13:31.501680 run osmo-msc_10.42.42.6(pid=943): stderr: | 20221209061330586 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061330586 DLGLOBAL DEBUG validating counter group 0x7f735de07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061330586 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061330586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061330586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061330586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061330588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061330588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061330589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061330589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:31.555263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Terminating (SIGTERM) 06:13:31.599169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Terminating (SIGTERM) 06:13:31.642651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=942): Terminating (SIGTERM) 06:13:31.687721 --- ParallelTerminationStrategy: PID 936 died... 06:13:31.708197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=936): Terminated: ok {rc=0} 06:13:31.756837 --- ParallelTerminationStrategy: PID 939 died... 06:13:31.776789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=939): Terminated: ok {rc=0} 06:13:31.823725 --- ParallelTerminationStrategy: PID 942 died... 06:13:31.843826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=942): Terminated: ok {rc=0} 06:13:31.931786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:13:33.137418 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:33.144099 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:13:33.177735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:13:33.204239 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:13:33.257537 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:13:33.290965 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:13:33.318069 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:13:33.869421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:13:33.920482 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:33.931959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:13:34.001754 tst mo_mt_call.py: using LAC 19489 06:13:34.121649 tst mo_mt_call.py: using RAC 109 06:13:34.249719 tst mo_mt_call.py: using CellId 19489 06:13:34.373041 tst mo_mt_call.py: using BVCI 19490 06:13:34.487675 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:34.499135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:34.510809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:34.522267 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:34.533663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:34.544817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:34.660012 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:34.773387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:35.229150 run create_hlr_db(pid=948): Launched 06:13:35.342836 bus /sierra_2: Setting Powered False 06:13:36.401952 run create_hlr_db(pid=948): Terminated: ok {rc=0} 06:13:36.812520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Launched 06:13:37.106381 run osmo-hlr_10.42.42.2(pid=951): Launched 06:13:37.219699 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:37.724303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Launched 06:13:38.018477 run osmo-stp_10.42.42.5(pid=955): Launched 06:13:38.130535 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:38.661119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=958): Launched 06:13:38.953722 run osmo-msc_10.42.42.6(pid=959): Launched 06:13:39.117832 run osmo-stp_10.42.42.5(pid=955): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] 06:13:39.243364 run osmo-stp_10.42.42.5(pid=955): stdout: | (launched: 2022-12-09_06:13:37.964863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:39.368272 run osmo-stp_10.42.42.5(pid=955): stderr: | 20221209061338132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061338133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061338133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061338133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061338135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061338136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061338136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:39.491013 run osmo-stp_10.42.42.5(pid=955): stdout: | (launched: 2022-12-09_06:13:37.964863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:39.607660 run osmo-stp_10.42.42.5(pid=955): stderr: | 20221209061338132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061338133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061338133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061338133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061338135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061338136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061338136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:39.747560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=955): Process ended prematurely: osmo-stp_10.42.42.5(pid=955) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:13:39.756300 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:13:39.782831 run osmo-hlr_10.42.42.2(pid=951): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=951)] 06:13:39.831342 run osmo-hlr_10.42.42.2(pid=951): stdout: | (launched: 2022-12-09_06:13:37.053192) 06:13:39.881557 run osmo-hlr_10.42.42.2(pid=951): stderr: | 20221209061337227 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061337227 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061337227 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061337227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061337227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061337227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061337238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061337247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061337247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061337247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:39.950897 run osmo-msc_10.42.42.6(pid=959): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=959)] 06:13:39.999090 run osmo-msc_10.42.42.6(pid=959): stdout: | (launched: 2022-12-09_06:13:38.900713) 06:13:40.048802 run osmo-msc_10.42.42.6(pid=959): stderr: | 20221209061339173 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061339173 DLGLOBAL DEBUG validating counter group 0x7f4a2051fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061339173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061339173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061339174 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061339174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061339175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061339176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061339176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061339176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:40.099039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Terminating (SIGTERM) 06:13:40.139153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Terminating (SIGTERM) 06:13:40.179517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=958): Terminating (SIGTERM) 06:13:40.220251 --- ParallelTerminationStrategy: PID 950 died... 06:13:40.239341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Terminated: ok {rc=0} 06:13:40.284579 --- ParallelTerminationStrategy: PID 954 died... 06:13:40.303305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Terminated: ok {rc=0} 06:13:40.347811 --- ParallelTerminationStrategy: PID 958 died... 06:13:40.366491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=958): Terminated: ok {rc=0} 06:13:40.450218 bus /sierra_3: Setting Powered False 06:13:41.548579 bus /sierra_3: Setting Powered False 06:13:42.664850 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:13:43.807356 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:43.819057 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:13:43.901445 tst mo_mt_call_osmux.py: using LAC 19490 06:13:44.024071 tst mo_mt_call_osmux.py: using RAC 110 06:13:44.141754 tst mo_mt_call_osmux.py: using CellId 19490 06:13:44.257900 tst mo_mt_call_osmux.py: using BVCI 19491 06:13:44.364939 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:44.375908 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:44.386706 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:44.398303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:44.409502 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:13:44.420421 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:44.537657 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:13:44.659209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:45.114938 run create_hlr_db(pid=961): Launched 06:13:45.226282 bus /sierra_2: Setting Powered False 06:13:46.284507 run create_hlr_db(pid=961): Terminated: ok {rc=0} 06:13:46.721063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=963): Launched 06:13:47.040799 run osmo-hlr_10.42.42.2(pid=964): Launched 06:13:47.214917 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:47.759760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=966): Launched 06:13:48.074258 run osmo-stp_10.42.42.5(pid=967): Launched 06:13:48.193545 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:48.766497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=969): Launched 06:13:49.079867 run osmo-msc_10.42.42.6(pid=970): Launched 06:13:49.255575 run osmo-stp_10.42.42.5(pid=967): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=967)] 06:13:49.390277 run osmo-stp_10.42.42.5(pid=967): stdout: | (launched: 2022-12-09_06:13:48.017751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:49.523913 run osmo-stp_10.42.42.5(pid=967): stderr: | 20221209061348208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061348208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061348208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061348209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061348209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061348209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061348209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:49.657210 run osmo-stp_10.42.42.5(pid=967): stdout: | (launched: 2022-12-09_06:13:48.017751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:13:49.782650 run osmo-stp_10.42.42.5(pid=967): stderr: | 20221209061348208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061348208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061348208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061348209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061348209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061348209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061348209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:13:49.932785 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=967): Process ended prematurely: osmo-stp_10.42.42.5(pid=967) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=967)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:13:49.942420 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:13:49.970193 run osmo-hlr_10.42.42.2(pid=964): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=964)] 06:13:50.020228 run osmo-hlr_10.42.42.2(pid=964): stdout: | (launched: 2022-12-09_06:13:46.968927) 06:13:50.072208 run osmo-hlr_10.42.42.2(pid=964): stderr: | 20221209061347229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061347229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061347229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061347229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061347229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061347229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061347242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061347250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061347250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061347250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:13:50.144512 run osmo-msc_10.42.42.6(pid=970): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=970)] 06:13:50.194078 run osmo-msc_10.42.42.6(pid=970): stdout: | (launched: 2022-12-09_06:13:49.022974) 06:13:50.245385 run osmo-msc_10.42.42.6(pid=970): stderr: | 20221209061349344 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061349345 DLGLOBAL DEBUG validating counter group 0x7f8ba6b87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061349345 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061349345 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061349345 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061349345 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061349347 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061349347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061349347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061349347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:13:50.297401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=963): Terminating (SIGTERM) 06:13:50.339644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=966): Terminating (SIGTERM) 06:13:50.381732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=969): Terminating (SIGTERM) 06:13:50.423999 --- ParallelTerminationStrategy: PID 963 died... 06:13:50.443771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=963): Terminated: ok {rc=0} 06:13:50.490456 --- ParallelTerminationStrategy: PID 966 died... 06:13:50.509937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=966): Terminated: ok {rc=0} 06:13:50.555499 --- ParallelTerminationStrategy: PID 969 died... 06:13:50.574698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=969): Terminated: ok {rc=0} 06:13:50.662142 bus /sierra_3: Setting Powered False 06:13:51.760465 bus /sierra_3: Setting Powered False 06:13:52.878371 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:13:54.128434 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:13:54.135508 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:13:54.168916 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:13:54.196223 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:13:54.254620 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:13:54.288305 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:13:54.315211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:13:54.857163 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:13:54.905201 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:54.916310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:13:54.983049 tst mo_mt_call.py: using LAC 19491 06:13:55.097211 tst mo_mt_call.py: using RAC 111 06:13:55.212056 tst mo_mt_call.py: using CellId 19491 06:13:55.326330 tst mo_mt_call.py: using BVCI 19492 06:13:55.433439 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:55.444230 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:55.455016 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:55.466138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:55.477403 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:13:55.488420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:55.604409 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:13:55.721692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:13:56.209401 run create_hlr_db(pid=975): Launched 06:13:56.338222 bus /sierra_2: Setting Powered False 06:13:57.401379 run create_hlr_db(pid=975): Terminated: ok {rc=0} 06:13:57.841290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=977): Launched 06:13:58.156046 run osmo-hlr_10.42.42.2(pid=978): Launched 06:13:58.276126 run osmo-stp_10.42.42.5: Starting osmo-stp 06:13:58.819486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=980): Launched 06:13:59.133210 run osmo-stp_10.42.42.5(pid=981): Launched 06:13:59.254062 run osmo-msc_10.42.42.6: Starting osmo-msc 06:13:59.824291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=983): Launched 06:14:00.139309 run osmo-msc_10.42.42.6(pid=984): Launched 06:14:00.316462 run osmo-stp_10.42.42.5(pid=981): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=981)] 06:14:00.451873 run osmo-stp_10.42.42.5(pid=981): stdout: | (launched: 2022-12-09_06:13:59.076381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:00.586989 run osmo-stp_10.42.42.5(pid=981): stderr: | 20221209061359267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061359267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061359268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061359268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061359268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061359268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061359269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:00.719970 run osmo-stp_10.42.42.5(pid=981): stdout: | (launched: 2022-12-09_06:13:59.076381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:00.850211 run osmo-stp_10.42.42.5(pid=981): stderr: | 20221209061359267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061359267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061359268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061359268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061359268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061359268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061359269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:01.005090 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=981): Process ended prematurely: osmo-stp_10.42.42.5(pid=981) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=981)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:14:01.015278 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:14:01.044067 run osmo-hlr_10.42.42.2(pid=978): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=978)] 06:14:01.095222 run osmo-hlr_10.42.42.2(pid=978): stdout: | (launched: 2022-12-09_06:13:58.099482) 06:14:01.148074 run osmo-hlr_10.42.42.2(pid=978): stderr: | 20221209061358295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061358295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061358296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061358296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061358296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061358296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061358309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061358318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061358318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061358318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:01.222128 run osmo-msc_10.42.42.6(pid=984): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=984)] 06:14:01.273444 run osmo-msc_10.42.42.6(pid=984): stdout: | (launched: 2022-12-09_06:14:00.082456) 06:14:01.326126 run osmo-msc_10.42.42.6(pid=984): stderr: | 20221209061400404 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061400404 DLGLOBAL DEBUG validating counter group 0x7f9571321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061400404 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061400404 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061400405 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061400405 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061400407 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061400407 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061400407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061400407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:01.379616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=977): Terminating (SIGTERM) 06:14:01.422566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=980): Terminating (SIGTERM) 06:14:01.465834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=983): Terminating (SIGTERM) 06:14:01.510141 --- ParallelTerminationStrategy: PID 977 died... 06:14:01.530326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=977): Terminated: ok {rc=0} 06:14:01.577393 --- ParallelTerminationStrategy: PID 980 died... 06:14:01.597530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=980): Terminated: ok {rc=0} 06:14:01.644789 --- ParallelTerminationStrategy: PID 983 died... 06:14:01.664740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=983): Terminated: ok {rc=0} 06:14:01.754547 bus /sierra_3: Setting Powered False 06:14:02.855449 bus /sierra_3: Setting Powered False 06:14:03.971142 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:14:05.119428 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.131381 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:14:05.201323 tst mo_mt_call_osmux.py: using LAC 19492 06:14:05.324634 tst mo_mt_call_osmux.py: using RAC 112 06:14:05.443190 tst mo_mt_call_osmux.py: using CellId 19492 06:14:05.561426 tst mo_mt_call_osmux.py: using BVCI 19493 06:14:05.670279 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.681329 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.692090 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.703949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.715580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:14:05.727258 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:05.841323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:14:05.958462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:06.448544 run create_hlr_db(pid=986): Launched 06:14:06.577160 bus /sierra_2: Setting Powered False 06:14:07.639349 run create_hlr_db(pid=986): Terminated: ok {rc=0} 06:14:08.058629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Launched 06:14:08.352912 run osmo-hlr_10.42.42.2(pid=990): Launched 06:14:08.465535 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:08.981890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Launched 06:14:09.275544 run osmo-stp_10.42.42.5(pid=997): Launched 06:14:09.387423 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:09.919400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Launched 06:14:10.214003 run osmo-msc_10.42.42.6(pid=1000): Launched 06:14:10.378734 run osmo-stp_10.42.42.5(pid=997): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] 06:14:10.506265 run osmo-stp_10.42.42.5(pid=997): stdout: | (launched: 2022-12-09_06:14:09.221138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:10.631695 run osmo-stp_10.42.42.5(pid=997): stderr: | 20221209061409394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061409394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061409394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061409395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061409395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061409395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061409395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:10.755185 run osmo-stp_10.42.42.5(pid=997): stdout: | (launched: 2022-12-09_06:14:09.221138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:10.872272 run osmo-stp_10.42.42.5(pid=997): stderr: | 20221209061409394 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061409394 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061409394 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061409395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061409395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061409395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061409395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:11.012644 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=997): Process ended prematurely: osmo-stp_10.42.42.5(pid=997) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:14:11.021698 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:14:11.048640 run osmo-hlr_10.42.42.2(pid=990): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=990)] 06:14:11.096759 run osmo-hlr_10.42.42.2(pid=990): stdout: | (launched: 2022-12-09_06:14:08.299446) 06:14:11.146610 run osmo-hlr_10.42.42.2(pid=990): stderr: | 20221209061408474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061408474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061408474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061408474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061408474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061408474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061408489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061408499 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061408499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061408499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:11.215964 run osmo-msc_10.42.42.6(pid=1000): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1000)] 06:14:11.264130 run osmo-msc_10.42.42.6(pid=1000): stdout: | (launched: 2022-12-09_06:14:10.160340) 06:14:11.313819 run osmo-msc_10.42.42.6(pid=1000): stderr: | 20221209061410431 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061410431 DLGLOBAL DEBUG validating counter group 0x7f39bff76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061410431 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061410431 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061410431 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061410432 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061410433 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061410434 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061410434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061410434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:11.363822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Terminating (SIGTERM) 06:14:11.404145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Terminating (SIGTERM) 06:14:11.444448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Terminating (SIGTERM) 06:14:11.485045 --- ParallelTerminationStrategy: PID 989 died... 06:14:11.504110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=989): Terminated: ok {rc=0} 06:14:11.549252 --- ParallelTerminationStrategy: PID 996 died... 06:14:11.567894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=996): Terminated: ok {rc=0} 06:14:11.612561 --- ParallelTerminationStrategy: PID 999 died... 06:14:11.631234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=999): Terminated: ok {rc=0} 06:14:11.717305 bus /sierra_3: Setting Powered False 06:14:12.817127 bus /sierra_3: Setting Powered False 06:14:13.934265 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:14:15.179878 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:15.186378 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:14:15.220526 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:14:15.247286 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:14:15.298742 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:14:15.333242 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:14:15.359860 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:14:15.924041 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:14:15.974292 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:15.985985 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:14:16.057444 tst mo_mt_call.py: using LAC 19493 06:14:16.222501 tst mo_mt_call.py: using RAC 113 06:14:16.344350 tst mo_mt_call.py: using CellId 19493 06:14:16.467390 tst mo_mt_call.py: using BVCI 19494 06:14:16.577266 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:16.588563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:16.599927 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:16.611977 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:16.623953 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:16.636083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:14:16.754587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:14:16.899365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:17.430746 run create_hlr_db(pid=1005): Launched 06:14:17.543975 bus /sierra_2: Setting Powered False 06:14:18.604323 run create_hlr_db(pid=1005): Terminated: ok {rc=0} 06:14:19.037199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Launched 06:14:19.354043 run osmo-hlr_10.42.42.2(pid=1008): Launched 06:14:19.474507 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:20.019072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Launched 06:14:20.334408 run osmo-stp_10.42.42.5(pid=1011): Launched 06:14:20.454368 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:21.024416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1013): Launched 06:14:21.339740 run osmo-msc_10.42.42.6(pid=1014): Launched 06:14:21.516276 run osmo-stp_10.42.42.5(pid=1011): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] 06:14:21.651473 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-09_06:14:20.277497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:21.785485 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221209061420466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061420466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061420467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061420467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061420468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061420468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061420468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:21.918948 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-09_06:14:20.277497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:22.044433 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221209061420466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061420466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061420467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061420467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061420468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061420468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061420468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:22.195376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:14:22.204566 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:14:22.232528 run osmo-hlr_10.42.42.2(pid=1008): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1008)] 06:14:22.283059 run osmo-hlr_10.42.42.2(pid=1008): stdout: | (launched: 2022-12-09_06:14:19.296326) 06:14:22.335571 run osmo-hlr_10.42.42.2(pid=1008): stderr: | 20221209061419491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061419491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061419491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061419491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061419491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061419491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061419504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061419514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061419515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061419515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:22.408646 run osmo-msc_10.42.42.6(pid=1014): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1014)] 06:14:22.458971 run osmo-msc_10.42.42.6(pid=1014): stdout: | (launched: 2022-12-09_06:14:21.282598) 06:14:22.510623 run osmo-msc_10.42.42.6(pid=1014): stderr: | 20221209061421605 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061421605 DLGLOBAL DEBUG validating counter group 0x7f8ad864bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061421605 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061421605 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061421605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061421606 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061421607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061421608 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061421608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061421608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:22.563020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminating (SIGTERM) 06:14:22.604680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminating (SIGTERM) 06:14:22.646680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1013): Terminating (SIGTERM) 06:14:22.688797 --- ParallelTerminationStrategy: PID 1007 died... 06:14:22.708783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminated: ok {rc=0} 06:14:22.755621 --- ParallelTerminationStrategy: PID 1010 died... 06:14:22.775382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminated: ok {rc=0} 06:14:22.822372 --- ParallelTerminationStrategy: PID 1013 died... 06:14:22.842189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1013): Terminated: ok {rc=0} 06:14:22.931120 bus /sierra_3: Setting Powered False 06:14:24.031512 bus /sierra_3: Setting Powered False 06:14:25.148548 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:14:26.291033 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.302442 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:14:26.369962 tst mo_mt_call_osmux.py: using LAC 19494 06:14:26.487582 tst mo_mt_call_osmux.py: using RAC 114 06:14:26.606012 tst mo_mt_call_osmux.py: using CellId 19494 06:14:26.732806 tst mo_mt_call_osmux.py: using BVCI 19495 06:14:26.840688 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.851628 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.862493 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.873470 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.884295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:14:26.895229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:14:27.013392 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:14:27.128114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:27.588120 run create_hlr_db(pid=1016): Launched 06:14:27.700340 bus /sierra_2: Setting Powered False 06:14:28.760174 run create_hlr_db(pid=1016): Terminated: ok {rc=0} 06:14:29.192453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1018): Launched 06:14:29.509561 run osmo-hlr_10.42.42.2(pid=1019): Launched 06:14:29.630838 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:30.177517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1021): Launched 06:14:30.492173 run osmo-stp_10.42.42.5(pid=1022): Launched 06:14:30.613104 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:31.200224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1024): Launched 06:14:31.513550 run osmo-msc_10.42.42.6(pid=1025): Launched 06:14:31.785913 run osmo-stp_10.42.42.5(pid=1022): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1022)] 06:14:32.095300 run osmo-stp_10.42.42.5(pid=1022): stdout: | (launched: 2022-12-09_06:14:30.435123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:32.345524 run osmo-stp_10.42.42.5(pid=1022): stderr: | 20221209061430626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061430626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061430626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061430627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061430629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061430629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061430629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:32.471604 run osmo-stp_10.42.42.5(pid=1022): stdout: | (launched: 2022-12-09_06:14:30.435123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:32.589239 run osmo-stp_10.42.42.5(pid=1022): stderr: | 20221209061430626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061430626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061430626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061430627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061430629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061430629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061430629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:32.729124 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1022): Process ended prematurely: osmo-stp_10.42.42.5(pid=1022) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1022)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:14:32.738266 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:14:32.765932 run osmo-hlr_10.42.42.2(pid=1019): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1019)] 06:14:32.814737 run osmo-hlr_10.42.42.2(pid=1019): stdout: | (launched: 2022-12-09_06:14:29.452519) 06:14:32.865177 run osmo-hlr_10.42.42.2(pid=1019): stderr: | 20221209061429649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061429649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061429649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061429649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061429649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061429649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061429661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061429671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061429671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061429671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:32.934980 run osmo-msc_10.42.42.6(pid=1025): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1025)] 06:14:32.983597 run osmo-msc_10.42.42.6(pid=1025): stdout: | (launched: 2022-12-09_06:14:31.455291) 06:14:33.034465 run osmo-msc_10.42.42.6(pid=1025): stderr: | 20221209061432156 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061432159 DLGLOBAL DEBUG validating counter group 0x7fe4b1f94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061432159 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061432159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061432160 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061432162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061432169 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061432171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061432171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061432171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:33.085331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1018): Terminating (SIGTERM) 06:14:33.125725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1021): Terminating (SIGTERM) 06:14:33.166250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1024): Terminating (SIGTERM) 06:14:33.207226 --- ParallelTerminationStrategy: PID 1018 died... 06:14:33.226330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1018): Terminated: ok {rc=0} 06:14:33.272180 --- ParallelTerminationStrategy: PID 1021 died... 06:14:33.290922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1021): Terminated: ok {rc=0} 06:14:33.336336 --- ParallelTerminationStrategy: PID 1024 died... 06:14:33.355126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1024): Terminated: ok {rc=0} 06:14:33.439649 bus /sierra_3: Setting Powered False 06:14:34.537452 bus /sierra_3: Setting Powered False 06:14:35.652869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:14:36.898381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:36.904531 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:14:36.937394 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:14:36.963484 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:14:37.015619 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:14:37.049172 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:14:37.075030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:14:37.622377 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:14:37.670100 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:37.681079 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:14:37.748041 tst mo_mt_call.py: using LAC 19495 06:14:37.863468 tst mo_mt_call.py: using RAC 115 06:14:37.978757 tst mo_mt_call.py: using CellId 19495 06:14:38.097271 tst mo_mt_call.py: using BVCI 19496 06:14:38.205490 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:38.216412 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:38.227178 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:38.238217 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:38.249221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:38.260129 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:38.373409 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:38.490361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:38.947684 run create_hlr_db(pid=1032): Launched 06:14:39.060238 bus /sierra_2: Setting Powered False 06:14:40.119770 run create_hlr_db(pid=1032): Terminated: ok {rc=0} 06:14:40.530392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Launched 06:14:40.822958 run osmo-hlr_10.42.42.2(pid=1035): Launched 06:14:40.934759 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:41.440186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Launched 06:14:41.735133 run osmo-stp_10.42.42.5(pid=1038): Launched 06:14:41.847156 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:42.381163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Launched 06:14:42.675232 run osmo-msc_10.42.42.6(pid=1041): Launched 06:14:42.840452 run osmo-stp_10.42.42.5(pid=1038): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] 06:14:42.967249 run osmo-stp_10.42.42.5(pid=1038): stdout: | (launched: 2022-12-09_06:14:41.681470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.093436 run osmo-stp_10.42.42.5(pid=1038): stderr: | 20221209061441852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061441853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061441853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061441853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061441854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061441854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061441854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:43.217173 run osmo-stp_10.42.42.5(pid=1038): stdout: | (launched: 2022-12-09_06:14:41.681470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:43.334559 run osmo-stp_10.42.42.5(pid=1038): stderr: | 20221209061441852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061441853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061441853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061441853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061441854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061441854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061441854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:43.475181 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1038): Process ended prematurely: osmo-stp_10.42.42.5(pid=1038) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:14:43.483903 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 06:14:43.511148 run osmo-hlr_10.42.42.2(pid=1035): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1035)] 06:14:43.559695 run osmo-hlr_10.42.42.2(pid=1035): stdout: | (launched: 2022-12-09_06:14:40.769574) 06:14:43.610114 run osmo-hlr_10.42.42.2(pid=1035): stderr: | 20221209061440942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061440942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061440942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061440942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061440943 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061440943 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061440954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061440963 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061440963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061440963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:43.680332 run osmo-msc_10.42.42.6(pid=1041): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1041)] 06:14:43.728904 run osmo-msc_10.42.42.6(pid=1041): stdout: | (launched: 2022-12-09_06:14:42.621492) 06:14:43.779015 run osmo-msc_10.42.42.6(pid=1041): stderr: | 20221209061442893 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061442893 DLGLOBAL DEBUG validating counter group 0x7efe05338c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061442893 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061442893 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061442894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061442894 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061442895 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061442896 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061442896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061442896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:43.829902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Terminating (SIGTERM) 06:14:43.870101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Terminating (SIGTERM) 06:14:43.910367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Terminating (SIGTERM) 06:14:43.950920 --- ParallelTerminationStrategy: PID 1034 died... 06:14:43.970100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1034): Terminated: ok {rc=0} 06:14:44.015323 --- ParallelTerminationStrategy: PID 1037 died... 06:14:44.034074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1037): Terminated: ok {rc=0} 06:14:44.078952 --- ParallelTerminationStrategy: PID 1040 died... 06:14:44.097619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1040): Terminated: ok {rc=0} 06:14:44.184180 bus /sierra_3: Setting Powered False 06:14:45.284210 bus /sierra_3: Setting Powered False 06:14:46.402203 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:14:47.556272 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:47.567788 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:14:47.635631 tst mo_mt_call_osmux.py: using LAC 19496 06:14:47.751540 tst mo_mt_call_osmux.py: using RAC 116 06:14:47.867178 tst mo_mt_call_osmux.py: using CellId 19496 06:14:47.984718 tst mo_mt_call_osmux.py: using BVCI 19497 06:14:48.091646 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:48.102581 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:48.113585 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:48.124494 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:48.135546 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:14:48.146590 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:48.261918 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:14:48.381750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:48.872011 run create_hlr_db(pid=1043): Launched 06:14:48.988390 bus /sierra_2: Setting Powered False 06:14:50.048279 run create_hlr_db(pid=1043): Terminated: ok {rc=0} 06:14:50.472125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Launched 06:14:50.772723 run osmo-hlr_10.42.42.2(pid=1046): Launched 06:14:50.894607 run osmo-stp_10.42.42.5: Starting osmo-stp 06:14:51.441958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Launched 06:14:51.757966 run osmo-stp_10.42.42.5(pid=1049): Launched 06:14:51.877710 run osmo-msc_10.42.42.6: Starting osmo-msc 06:14:52.448535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Launched 06:14:52.764012 run osmo-msc_10.42.42.6(pid=1052): Launched 06:14:52.939980 run osmo-stp_10.42.42.5(pid=1049): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] 06:14:53.074615 run osmo-stp_10.42.42.5(pid=1049): stdout: | (launched: 2022-12-09_06:14:51.700520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:53.209381 run osmo-stp_10.42.42.5(pid=1049): stderr: | 20221209061451890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061451890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061451891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061451891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061451893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061451893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061451894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:53.343788 run osmo-stp_10.42.42.5(pid=1049): stdout: | (launched: 2022-12-09_06:14:51.700520) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:14:53.469953 run osmo-stp_10.42.42.5(pid=1049): stderr: | 20221209061451890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061451890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061451891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061451891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061451893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061451893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061451894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:14:53.621199 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1049): Process ended prematurely: osmo-stp_10.42.42.5(pid=1049) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:14:53.630666 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:14:53.658463 run osmo-hlr_10.42.42.2(pid=1046): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1046)] 06:14:53.708605 run osmo-hlr_10.42.42.2(pid=1046): stdout: | (launched: 2022-12-09_06:14:50.715042) 06:14:53.760604 run osmo-hlr_10.42.42.2(pid=1046): stderr: | 20221209061450911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061450911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061450911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061450911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061450911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061450911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061450923 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061450931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061450932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061450932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:14:53.832573 run osmo-msc_10.42.42.6(pid=1052): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1052)] 06:14:53.882607 run osmo-msc_10.42.42.6(pid=1052): stdout: | (launched: 2022-12-09_06:14:52.707223) 06:14:53.934386 run osmo-msc_10.42.42.6(pid=1052): stderr: | 20221209061453028 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061453028 DLGLOBAL DEBUG validating counter group 0x7fa1d50f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061453028 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061453028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061453029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061453029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061453030 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061453031 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061453031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061453031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:14:53.986589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Terminating (SIGTERM) 06:14:54.028569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Terminating (SIGTERM) 06:14:54.070483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Terminating (SIGTERM) 06:14:54.112672 --- ParallelTerminationStrategy: PID 1045 died... 06:14:54.132723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1045): Terminated: ok {rc=0} 06:14:54.179213 --- ParallelTerminationStrategy: PID 1048 died... 06:14:54.198833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1048): Terminated: ok {rc=0} 06:14:54.245068 --- ParallelTerminationStrategy: PID 1051 died... 06:14:54.264660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1051): Terminated: ok {rc=0} 06:14:54.352380 bus /sierra_3: Setting Powered False 06:14:55.451818 bus /sierra_3: Setting Powered False 06:14:56.569335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:14:57.822137 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:14:57.828640 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:14:57.861324 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:14:57.887405 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:14:57.937666 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:14:57.969632 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:14:57.995262 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:14:58.549417 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:14:58.601351 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:58.612770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:14:58.683915 tst mo_mt_call.py: using LAC 19497 06:14:58.810159 tst mo_mt_call.py: using RAC 117 06:14:58.935842 tst mo_mt_call.py: using CellId 19497 06:14:59.059658 tst mo_mt_call.py: using BVCI 19498 06:14:59.174982 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:59.186337 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:59.197559 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:59.208663 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:59.219938 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:14:59.231124 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:59.344024 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:14:59.460708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:14:59.953460 run create_hlr_db(pid=1057): Launched 06:15:00.082143 bus /sierra_2: Setting Powered False 06:15:01.144262 run create_hlr_db(pid=1057): Terminated: ok {rc=0} 06:15:01.594838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1059): Launched 06:15:01.941621 run osmo-hlr_10.42.42.2(pid=1063): Launched 06:15:02.121917 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:02.761878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Launched 06:15:03.077356 run osmo-stp_10.42.42.5(pid=1066): Launched 06:15:03.198011 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:03.770991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Launched 06:15:04.086301 run osmo-msc_10.42.42.6(pid=1069): Launched 06:15:04.261771 run osmo-stp_10.42.42.5(pid=1066): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] 06:15:04.396475 run osmo-stp_10.42.42.5(pid=1066): stdout: | (launched: 2022-12-09_06:15:03.020085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:04.530464 run osmo-stp_10.42.42.5(pid=1066): stderr: | 20221209061503211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061503211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061503211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061503212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061503212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061503212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061503212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:04.663837 run osmo-stp_10.42.42.5(pid=1066): stdout: | (launched: 2022-12-09_06:15:03.020085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:04.789868 run osmo-stp_10.42.42.5(pid=1066): stderr: | 20221209061503211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061503211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061503211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061503212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061503212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061503212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061503212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:04.940356 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1066): Process ended prematurely: osmo-stp_10.42.42.5(pid=1066) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:15:04.950056 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:15:04.978164 run osmo-hlr_10.42.42.2(pid=1063): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1063)] 06:15:05.029056 run osmo-hlr_10.42.42.2(pid=1063): stdout: | (launched: 2022-12-09_06:15:01.867719) 06:15:05.081647 run osmo-hlr_10.42.42.2(pid=1063): stderr: | 20221209061502263 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061502263 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061502263 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061502263 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061502264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061502264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061502292 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061502319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061502319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061502319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:05.154646 run osmo-msc_10.42.42.6(pid=1069): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1069)] 06:15:05.205475 run osmo-msc_10.42.42.6(pid=1069): stdout: | (launched: 2022-12-09_06:15:04.029246) 06:15:05.258074 run osmo-msc_10.42.42.6(pid=1069): stderr: | 20221209061504355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061504355 DLGLOBAL DEBUG validating counter group 0x7f485c91ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061504355 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061504355 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061504355 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061504355 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061504357 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061504357 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061504358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061504358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:05.310992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1059): Terminating (SIGTERM) 06:15:05.353448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Terminating (SIGTERM) 06:15:05.396179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Terminating (SIGTERM) 06:15:05.439098 --- ParallelTerminationStrategy: PID 1059 died... 06:15:05.459151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1059): Terminated: ok {rc=0} 06:15:05.506082 --- ParallelTerminationStrategy: PID 1065 died... 06:15:05.525918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1065): Terminated: ok {rc=0} 06:15:05.572746 --- ParallelTerminationStrategy: PID 1068 died... 06:15:05.592687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1068): Terminated: ok {rc=0} 06:15:05.680588 bus /sierra_3: Setting Powered False 06:15:06.779573 bus /sierra_3: Setting Powered False 06:15:07.897079 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:15:09.042095 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.053601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:15:09.125991 tst mo_mt_call_osmux.py: using LAC 19498 06:15:09.253653 tst mo_mt_call_osmux.py: using RAC 118 06:15:09.379748 tst mo_mt_call_osmux.py: using CellId 19498 06:15:09.503137 tst mo_mt_call_osmux.py: using BVCI 19499 06:15:09.618058 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.629728 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.641107 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.652551 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.664063 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:15:09.675431 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:15:09.794071 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:15:09.906956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:10.364354 run create_hlr_db(pid=1071): Launched 06:15:10.477529 bus /sierra_2: Setting Powered False 06:15:11.537450 run create_hlr_db(pid=1071): Terminated: ok {rc=0} 06:15:11.949352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Launched 06:15:12.243983 run osmo-hlr_10.42.42.2(pid=1074): Launched 06:15:12.356378 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:12.861896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Launched 06:15:13.155675 run osmo-stp_10.42.42.5(pid=1077): Launched 06:15:13.267791 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:13.801074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Launched 06:15:14.095814 run osmo-msc_10.42.42.6(pid=1080): Launched 06:15:14.261595 run osmo-stp_10.42.42.5(pid=1077): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] 06:15:14.388402 run osmo-stp_10.42.42.5(pid=1077): stdout: | (launched: 2022-12-09_06:15:13.102564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:14.514425 run osmo-stp_10.42.42.5(pid=1077): stderr: | 20221209061513272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061513272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061513272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061513273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061513273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061513273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061513273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:14.638125 run osmo-stp_10.42.42.5(pid=1077): stdout: | (launched: 2022-12-09_06:15:13.102564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:14.755515 run osmo-stp_10.42.42.5(pid=1077): stderr: | 20221209061513272 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061513272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061513272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061513273 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061513273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061513273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061513273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:14.896037 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1077): Process ended prematurely: osmo-stp_10.42.42.5(pid=1077) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:15:14.905016 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:15:14.932088 run osmo-hlr_10.42.42.2(pid=1074): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1074)] 06:15:14.981164 run osmo-hlr_10.42.42.2(pid=1074): stdout: | (launched: 2022-12-09_06:15:12.190463) 06:15:15.031579 run osmo-hlr_10.42.42.2(pid=1074): stderr: | 20221209061512364 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061512365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061512365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061512365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061512365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061512365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061512377 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061512387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061512387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061512387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:15.101711 run osmo-msc_10.42.42.6(pid=1080): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1080)] 06:15:15.150238 run osmo-msc_10.42.42.6(pid=1080): stdout: | (launched: 2022-12-09_06:15:14.042167) 06:15:15.200374 run osmo-msc_10.42.42.6(pid=1080): stderr: | 20221209061514310 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061514310 DLGLOBAL DEBUG validating counter group 0x7f32e4d6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061514310 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061514310 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061514310 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061514310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061514312 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061514314 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061514314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061514314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:15.251180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Terminating (SIGTERM) 06:15:15.291228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Terminating (SIGTERM) 06:15:15.331253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Terminating (SIGTERM) 06:15:15.371750 --- ParallelTerminationStrategy: PID 1073 died... 06:15:15.390954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1073): Terminated: ok {rc=0} 06:15:15.435973 --- ParallelTerminationStrategy: PID 1076 died... 06:15:15.454732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1076): Terminated: ok {rc=0} 06:15:15.499401 --- ParallelTerminationStrategy: PID 1079 died... 06:15:15.518225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1079): Terminated: ok {rc=0} 06:15:15.604507 bus /sierra_3: Setting Powered False 06:15:16.703079 bus /sierra_3: Setting Powered False 06:15:17.822274 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:15:19.070175 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:19.078494 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:15:19.112051 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:15:19.139361 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:15:19.190868 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:15:19.224219 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:15:19.251274 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:15:19.804097 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:15:19.854665 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:19.866149 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:15:19.936051 tst mo_mt_call.py: using LAC 19499 06:15:20.059231 tst mo_mt_call.py: using RAC 119 06:15:20.177323 tst mo_mt_call.py: using CellId 19499 06:15:20.293180 tst mo_mt_call.py: using BVCI 19500 06:15:20.400291 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:20.411504 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:20.422480 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:20.433918 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:20.445475 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:20.456558 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:15:20.573300 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:15:20.691747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:21.150796 run create_hlr_db(pid=1086): Launched 06:15:21.263378 bus /sierra_2: Setting Powered False 06:15:22.323471 run create_hlr_db(pid=1086): Terminated: ok {rc=0} 06:15:22.735103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1088): Launched 06:15:23.029147 run osmo-hlr_10.42.42.2(pid=1089): Launched 06:15:23.142064 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:23.648589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1091): Launched 06:15:23.942227 run osmo-stp_10.42.42.5(pid=1092): Launched 06:15:24.054114 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:24.586345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1094): Launched 06:15:24.880375 run osmo-msc_10.42.42.6(pid=1095): Launched 06:15:25.045338 run osmo-stp_10.42.42.5(pid=1092): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1092)] 06:15:25.171282 run osmo-stp_10.42.42.5(pid=1092): stdout: | (launched: 2022-12-09_06:15:23.888850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:25.296780 run osmo-stp_10.42.42.5(pid=1092): stderr: | 20221209061524055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061524055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061524056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061524056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061524056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061524057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061524057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:25.420046 run osmo-stp_10.42.42.5(pid=1092): stdout: | (launched: 2022-12-09_06:15:23.888850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:25.536589 run osmo-stp_10.42.42.5(pid=1092): stderr: | 20221209061524055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061524055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061524056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061524056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061524056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061524057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061524057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:25.676823 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1092): Process ended prematurely: osmo-stp_10.42.42.5(pid=1092) [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1092)] [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:15:25.685551 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:15:25.712029 run osmo-hlr_10.42.42.2(pid=1089): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1089)] 06:15:25.759908 run osmo-hlr_10.42.42.2(pid=1089): stdout: | (launched: 2022-12-09_06:15:22.975526) 06:15:25.809421 run osmo-hlr_10.42.42.2(pid=1089): stderr: | 20221209061523150 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061523151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061523151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061523151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061523151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061523151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061523166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061523175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061523175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061523176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:25.878727 run osmo-msc_10.42.42.6(pid=1095): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1095)] 06:15:25.926380 run osmo-msc_10.42.42.6(pid=1095): stdout: | (launched: 2022-12-09_06:15:24.826615) 06:15:25.975571 run osmo-msc_10.42.42.6(pid=1095): stderr: | 20221209061525096 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061525096 DLGLOBAL DEBUG validating counter group 0x7fae9c303c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061525096 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061525096 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061525097 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061525097 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061525099 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061525099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061525099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061525099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:26.025242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1088): Terminating (SIGTERM) 06:15:26.064844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1091): Terminating (SIGTERM) 06:15:26.104682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1094): Terminating (SIGTERM) 06:15:26.144819 --- ParallelTerminationStrategy: PID 1088 died... 06:15:26.163842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1088): Terminated: ok {rc=0} 06:15:26.208062 --- ParallelTerminationStrategy: PID 1091 died... 06:15:26.226542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1091): Terminated: ok {rc=0} 06:15:26.270886 --- ParallelTerminationStrategy: PID 1094 died... 06:15:26.289396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1094): Terminated: ok {rc=0} 06:15:26.372498 bus /sierra_3: Setting Powered False 06:15:27.470852 bus /sierra_3: Setting Powered False 06:15:28.589836 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:15:29.733524 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:29.745131 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:15:29.818774 tst mo_mt_call_osmux.py: using LAC 19500 06:15:29.936290 tst mo_mt_call_osmux.py: using RAC 120 06:15:30.051375 tst mo_mt_call_osmux.py: using CellId 19500 06:15:30.175546 tst mo_mt_call_osmux.py: using BVCI 19501 06:15:30.291247 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:30.303015 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:30.314652 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:30.326744 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:30.338543 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:15:30.350292 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:15:30.463645 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:15:30.580513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:31.098825 run create_hlr_db(pid=1097): Launched 06:15:31.271385 bus /sierra_2: Setting Powered False 06:15:32.332284 run create_hlr_db(pid=1097): Terminated: ok {rc=0} 06:15:32.804778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1099): Launched 06:15:33.121375 run osmo-hlr_10.42.42.2(pid=1100): Launched 06:15:33.241689 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:33.791660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1102): Launched 06:15:34.107433 run osmo-stp_10.42.42.5(pid=1103): Launched 06:15:34.226946 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:34.802839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1105): Launched 06:15:35.119705 run osmo-msc_10.42.42.6(pid=1106): Launched 06:15:35.295444 run osmo-stp_10.42.42.5(pid=1103): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1103)] 06:15:35.430323 run osmo-stp_10.42.42.5(pid=1103): stdout: | (launched: 2022-12-09_06:15:34.050153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:35.564816 run osmo-stp_10.42.42.5(pid=1103): stderr: | 20221209061534241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061534241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061534242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061534242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061534243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061534243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061534243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:35.698980 run osmo-stp_10.42.42.5(pid=1103): stdout: | (launched: 2022-12-09_06:15:34.050153) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:35.824517 run osmo-stp_10.42.42.5(pid=1103): stderr: | 20221209061534241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061534241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061534242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061534242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061534243 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061534243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061534243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:35.975833 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1103): Process ended prematurely: osmo-stp_10.42.42.5(pid=1103) [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1103)] [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:15:35.985211 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:15:36.012773 run osmo-hlr_10.42.42.2(pid=1100): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1100)] 06:15:36.062933 run osmo-hlr_10.42.42.2(pid=1100): stdout: | (launched: 2022-12-09_06:15:33.063892) 06:15:36.114905 run osmo-hlr_10.42.42.2(pid=1100): stderr: | 20221209061533261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061533261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061533261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061533262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061533262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061533262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061533275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061533285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061533285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061533285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:36.187124 run osmo-msc_10.42.42.6(pid=1106): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1106)] 06:15:36.237464 run osmo-msc_10.42.42.6(pid=1106): stdout: | (launched: 2022-12-09_06:15:35.061512) 06:15:36.289093 run osmo-msc_10.42.42.6(pid=1106): stderr: | 20221209061535384 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061535384 DLGLOBAL DEBUG validating counter group 0x7f96271b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061535384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061535384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061535384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061535384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061535386 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061535387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061535387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061535387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:36.341281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1099): Terminating (SIGTERM) 06:15:36.382785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1102): Terminating (SIGTERM) 06:15:36.424863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1105): Terminating (SIGTERM) 06:15:36.467028 --- ParallelTerminationStrategy: PID 1099 died... 06:15:36.486596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1099): Terminated: ok {rc=0} 06:15:36.532462 --- ParallelTerminationStrategy: PID 1102 died... 06:15:36.551862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1102): Terminated: ok {rc=0} 06:15:36.597478 --- ParallelTerminationStrategy: PID 1105 died... 06:15:36.617051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1105): Terminated: ok {rc=0} 06:15:36.703968 bus /sierra_3: Setting Powered False 06:15:37.802657 bus /sierra_3: Setting Powered False 06:15:38.919060 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:15:40.166580 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:15:40.172189 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:15:40.205135 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:15:40.231132 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:15:40.282765 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:15:40.315369 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:15:40.341371 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:15:40.887687 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:15:40.941171 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:40.952421 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:15:41.026851 tst mo_mt_call.py: using LAC 19501 06:15:41.144012 tst mo_mt_call.py: using RAC 121 06:15:41.259109 tst mo_mt_call.py: using CellId 19501 06:15:41.373437 tst mo_mt_call.py: using BVCI 19502 06:15:41.490609 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:41.501732 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:41.512695 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:41.524398 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:41.535858 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:41.547362 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:41.662158 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:41.779789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:42.271455 run create_hlr_db(pid=1111): Launched 06:15:42.400492 bus /sierra_2: Setting Powered False 06:15:43.459951 run create_hlr_db(pid=1111): Terminated: ok {rc=0} 06:15:43.898577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Launched 06:15:44.214682 run osmo-hlr_10.42.42.2(pid=1115): Launched 06:15:44.334547 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:44.877627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Launched 06:15:45.192426 run osmo-stp_10.42.42.5(pid=1118): Launched 06:15:45.313890 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:45.894082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Launched 06:15:46.246500 run osmo-msc_10.42.42.6(pid=1122): Launched 06:15:46.665779 run osmo-stp_10.42.42.5(pid=1118): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] 06:15:46.906584 run osmo-stp_10.42.42.5(pid=1118): stdout: | (launched: 2022-12-09_06:15:45.135273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:47.041807 run osmo-stp_10.42.42.5(pid=1118): stderr: | 20221209061545328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061545328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061545329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061545329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061545329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061545329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061545330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:47.176906 run osmo-stp_10.42.42.5(pid=1118): stdout: | (launched: 2022-12-09_06:15:45.135273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:47.310511 run osmo-stp_10.42.42.5(pid=1118): stderr: | 20221209061545328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061545328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061545329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061545329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061545329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061545329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061545330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:47.462075 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1118): Process ended prematurely: osmo-stp_10.42.42.5(pid=1118) [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:15:47.471416 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:15:47.498702 run osmo-hlr_10.42.42.2(pid=1115): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1115)] 06:15:47.548498 run osmo-hlr_10.42.42.2(pid=1115): stdout: | (launched: 2022-12-09_06:15:44.157708) 06:15:47.600103 run osmo-hlr_10.42.42.2(pid=1115): stderr: | 20221209061544355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061544355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061544355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061544355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061544355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061544355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061544367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061544376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061544376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061544376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:47.671947 run osmo-msc_10.42.42.6(pid=1122): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1122)] 06:15:47.721947 run osmo-msc_10.42.42.6(pid=1122): stdout: | (launched: 2022-12-09_06:15:46.175026) 06:15:47.773591 run osmo-msc_10.42.42.6(pid=1122): stderr: | 20221209061546576 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061546576 DLGLOBAL DEBUG validating counter group 0x7f27d6454c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061546578 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061546578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061546578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061546578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061546580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061546582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061546582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061546582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:47.825500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Terminating (SIGTERM) 06:15:47.867095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Terminating (SIGTERM) 06:15:47.908908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Terminating (SIGTERM) 06:15:47.950921 --- ParallelTerminationStrategy: PID 1114 died... 06:15:47.970657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1114): Terminated: ok {rc=0} 06:15:48.017142 --- ParallelTerminationStrategy: PID 1117 died... 06:15:48.037015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1117): Terminated: ok {rc=0} 06:15:48.082879 --- ParallelTerminationStrategy: PID 1121 died... 06:15:48.102248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1121): Terminated: ok {rc=0} 06:15:48.189696 bus /sierra_3: Setting Powered False 06:15:49.289057 bus /sierra_3: Setting Powered False 06:15:50.404867 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:15:51.552650 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:51.564353 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:15:51.636623 tst mo_mt_call_osmux.py: using LAC 19502 06:15:51.762537 tst mo_mt_call_osmux.py: using RAC 122 06:15:51.888455 tst mo_mt_call_osmux.py: using CellId 19502 06:15:52.012902 tst mo_mt_call_osmux.py: using BVCI 19503 06:15:52.128062 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:52.139296 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:52.150395 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:52.161486 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:52.172513 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:15:52.183687 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:52.300900 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:15:52.414663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:15:52.870638 run create_hlr_db(pid=1128): Launched 06:15:52.984001 bus /sierra_2: Setting Powered False 06:15:54.043670 run create_hlr_db(pid=1128): Terminated: ok {rc=0} 06:15:54.455317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Launched 06:15:54.749656 run osmo-hlr_10.42.42.2(pid=1131): Launched 06:15:54.861568 run osmo-stp_10.42.42.5: Starting osmo-stp 06:15:55.385075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Launched 06:15:55.678235 run osmo-stp_10.42.42.5(pid=1139): Launched 06:15:55.789743 run osmo-msc_10.42.42.6: Starting osmo-msc 06:15:56.323065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Launched 06:15:56.616816 run osmo-msc_10.42.42.6(pid=1142): Launched 06:15:56.782140 run osmo-stp_10.42.42.5(pid=1139): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] 06:15:56.908833 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-09_06:15:55.624876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:57.035604 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221209061555794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061555795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061555795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061555795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061555796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061555796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061555796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:57.159190 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-09_06:15:55.624876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:15:57.276623 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221209061555794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061555795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061555795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061555795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061555796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061555796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061555796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:15:57.417531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:15:57.426290 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:15:57.452941 run osmo-hlr_10.42.42.2(pid=1131): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1131)] 06:15:57.501136 run osmo-hlr_10.42.42.2(pid=1131): stdout: | (launched: 2022-12-09_06:15:54.695975) 06:15:57.551105 run osmo-hlr_10.42.42.2(pid=1131): stderr: | 20221209061554869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061554869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061554869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061554869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061554869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061554869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061554882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061554891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061554891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061554891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:15:57.620599 run osmo-msc_10.42.42.6(pid=1142): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1142)] 06:15:57.668488 run osmo-msc_10.42.42.6(pid=1142): stdout: | (launched: 2022-12-09_06:15:56.563400) 06:15:57.718388 run osmo-msc_10.42.42.6(pid=1142): stderr: | 20221209061556833 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061556833 DLGLOBAL DEBUG validating counter group 0x7f4032db6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061556833 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061556833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061556834 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061556834 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061556836 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061556836 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061556836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061556836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:15:57.768689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminating (SIGTERM) 06:15:57.809187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminating (SIGTERM) 06:15:57.849273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminating (SIGTERM) 06:15:57.890048 --- ParallelTerminationStrategy: PID 1130 died... 06:15:57.909380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminated: ok {rc=0} 06:15:57.954415 --- ParallelTerminationStrategy: PID 1133 died... 06:15:57.973222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminated: ok {rc=0} 06:15:58.017984 --- ParallelTerminationStrategy: PID 1141 died... 06:15:58.036988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1141): Terminated: ok {rc=0} 06:15:58.121295 bus /sierra_3: Setting Powered False 06:15:59.220235 bus /sierra_3: Setting Powered False 06:16:00.334825 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:trx-lms --------------------------------------------------------------------- 06:16:01.586183 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:01.590355 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 06:16:01.633448 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 06:16:01.665675 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 06:16:01.767686 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 06:16:01.820595 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 06:16:01.863006 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 06:16:02.409943 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 06:16:02.415710 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.427171 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:16:02.475726 tst emergency_mo_mt_call.py: using LAC 19503 06:16:02.590725 tst emergency_mo_mt_call.py: using RAC 123 06:16:02.709300 tst emergency_mo_mt_call.py: using CellId 19503 06:16:02.822353 tst emergency_mo_mt_call.py: using BVCI 19504 06:16:02.926709 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.937234 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.947456 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.958017 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.968549 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:02.979067 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:03.095394 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:03.214914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:03.696386 run create_hlr_db(pid=1148): Launched 06:16:03.822495 bus /sierra_2: Setting Powered False 06:16:04.884129 run create_hlr_db(pid=1148): Terminated: ok {rc=0} 06:16:05.300283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Launched 06:16:05.589945 run osmo-hlr_10.42.42.2(pid=1151): Launched 06:16:05.700632 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:06.211914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Launched 06:16:06.500439 run osmo-stp_10.42.42.5(pid=1154): Launched 06:16:06.618893 tst emergency_mo_mt_call.py: using MSISDN 7057 06:16:06.782892 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:07.302216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Launched 06:16:07.590420 run osmo-msc_10.42.42.6(pid=1157): Launched 06:16:07.751115 run osmo-stp_10.42.42.5(pid=1154): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] 06:16:07.873847 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_06:16:06.447691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:07.997742 run osmo-stp_10.42.42.5(pid=1154): stderr: | 20221209061606617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061606617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061606618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061606618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061606619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061606619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061606619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:08.118971 run osmo-stp_10.42.42.5(pid=1154): stdout: | (launched: 2022-12-09_06:16:06.447691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:08.234493 run osmo-stp_10.42.42.5(pid=1154): stderr: | 20221209061606617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061606617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061606618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061606618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061606619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061606619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061606619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:08.371863 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 06:16:08.380051 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 06:16:08.406078 run osmo-hlr_10.42.42.2(pid=1151): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1151)] 06:16:08.454331 run osmo-hlr_10.42.42.2(pid=1151): stdout: | (launched: 2022-12-09_06:16:05.537422) 06:16:08.504104 run osmo-hlr_10.42.42.2(pid=1151): stderr: | 20221209061605711 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061605711 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061605711 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061605711 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061605711 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061605711 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061605723 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061605731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061605731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061605731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:08.573338 run osmo-msc_10.42.42.6(pid=1157): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1157)] 06:16:08.621184 run osmo-msc_10.42.42.6(pid=1157): stdout: | (launched: 2022-12-09_06:16:07.537981) 06:16:08.670849 run osmo-msc_10.42.42.6(pid=1157): stderr: | 20221209061607809 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061607809 DLGLOBAL DEBUG validating counter group 0x7fdc6ddc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061607809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061607809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061607809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061607809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061607812 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061607812 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061607812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061607812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:08.720844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminating (SIGTERM) 06:16:08.761138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminating (SIGTERM) 06:16:08.801322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminating (SIGTERM) 06:16:08.841690 --- ParallelTerminationStrategy: PID 1150 died... 06:16:08.860615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1150): Terminated: ok {rc=0} 06:16:08.905282 --- ParallelTerminationStrategy: PID 1153 died... 06:16:08.923756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1153): Terminated: ok {rc=0} 06:16:08.968082 --- ParallelTerminationStrategy: PID 1156 died... 06:16:08.986570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1156): Terminated: ok {rc=0} 06:16:09.073510 bus /sierra_3: Setting Powered False 06:16:10.172732 bus /sierra_3: Setting Powered False 06:16:11.287105 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 06:16:12.374082 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.385126 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 06:16:12.434954 tst emergency_preemptive_call.py: using LAC 19504 06:16:12.551019 tst emergency_preemptive_call.py: using RAC 124 06:16:12.663798 tst emergency_preemptive_call.py: using CellId 19504 06:16:12.776765 tst emergency_preemptive_call.py: using BVCI 19505 06:16:12.882871 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.893455 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.903707 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.914289 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.924860 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 06:16:12.935379 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:13.046983 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:13.164425 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:13.277211 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 06:16:13.389179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:13.838118 run create_hlr_db(pid=1159): Launched 06:16:13.947813 bus /sierra_2: Setting Powered False 06:16:15.005425 run create_hlr_db(pid=1159): Terminated: ok {rc=0} 06:16:15.430596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Launched 06:16:15.740838 run osmo-hlr_10.42.42.2(pid=1162): Launched 06:16:15.866788 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:16.698750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Launched 06:16:17.042258 run osmo-stp_10.42.42.5(pid=1165): Launched 06:16:17.283341 tst emergency_preemptive_call.py: using MSISDN 7058 06:16:17.460841 run osmo-msc_10.42.42.6: Starting osmo-msc 06:16:18.017844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Launched 06:16:18.327680 run osmo-msc_10.42.42.6(pid=1168): Launched 06:16:18.499767 run osmo-stp_10.42.42.5(pid=1165): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] 06:16:18.631252 run osmo-stp_10.42.42.5(pid=1165): stdout: | (launched: 2022-12-09_06:16:16.968139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:18.763554 run osmo-stp_10.42.42.5(pid=1165): stderr: | 20221209061617296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061617296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061617296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061617305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061617307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061617308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061617308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:18.894439 run osmo-stp_10.42.42.5(pid=1165): stdout: | (launched: 2022-12-09_06:16:16.968139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:19.017237 run osmo-stp_10.42.42.5(pid=1165): stderr: | 20221209061617296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061617296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061617296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061617305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061617307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061617308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061617308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:19.164300 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1165): Process ended prematurely: osmo-stp_10.42.42.5(pid=1165) [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py:32] 06:16:19.173167 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 06:16:19.200186 run osmo-hlr_10.42.42.2(pid=1162): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1162)] 06:16:19.249866 run osmo-hlr_10.42.42.2(pid=1162): stdout: | (launched: 2022-12-09_06:16:15.684686) 06:16:19.301382 run osmo-hlr_10.42.42.2(pid=1162): stderr: | 20221209061615944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061615944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061615944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061615944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061615944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061615944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061615972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061615980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061615980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061615989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:19.373282 run osmo-msc_10.42.42.6(pid=1168): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1168)] 06:16:19.422973 run osmo-msc_10.42.42.6(pid=1168): stdout: | (launched: 2022-12-09_06:16:18.271316) 06:16:19.474625 run osmo-msc_10.42.42.6(pid=1168): stderr: | 20221209061618593 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209061618593 DLGLOBAL DEBUG validating counter group 0x7fa9584cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209061618593 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209061618593 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209061618593 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209061618593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209061618595 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209061618596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209061618596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209061618596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:16:19.526267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Terminating (SIGTERM) 06:16:19.567750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Terminating (SIGTERM) 06:16:19.609407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Terminating (SIGTERM) 06:16:19.651065 --- ParallelTerminationStrategy: PID 1161 died... 06:16:19.670787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1161): Terminated: ok {rc=0} 06:16:19.716606 --- ParallelTerminationStrategy: PID 1164 died... 06:16:19.736053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1164): Terminated: ok {rc=0} 06:16:19.781922 --- ParallelTerminationStrategy: PID 1167 died... 06:16:19.801368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1167): Terminated: ok {rc=0} 06:16:19.888098 bus /sierra_9: Setting Powered False 06:16:20.987062 bus /sierra_9: Setting Powered False 06:16:22.102448 bus /sierra_8: Setting Powered False 06:16:23.198688 bus /sierra_8: Setting Powered False 06:16:24.314491 bus /sierra_3: Setting Powered False 06:16:25.413001 bus /sierra_3: Setting Powered False 06:16:26.529063 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms --------------------------------------------------------------------- 06:16:27.798329 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:16:27.802446 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 06:16:27.835794 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 06:16:27.873651 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 06:16:27.958172 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 06:16:27.990591 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 06:16:28.028362 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 06:16:28.615125 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 06:16:28.663565 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:28.673998 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:28.721270 tst cs_paging_gprs_active.py: using LAC 19505 06:16:28.838824 tst cs_paging_gprs_active.py: using RAC 125 06:16:28.963652 tst cs_paging_gprs_active.py: using CellId 19505 06:16:29.088071 tst cs_paging_gprs_active.py: using BVCI 19506 06:16:29.203026 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.214339 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.225194 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.236008 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.246624 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.257200 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.267962 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.278599 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:29.289382 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:29.406426 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:29.524179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:16:29.736795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:30.054468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Launched 06:16:30.330006 run iperf3-srv_10.42.42.10(pid=1177): Launched 06:16:30.449948 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:16:30.661797 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:30.997838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1178): Launched 06:16:31.293427 run iperf3-srv_10.42.42.10(pid=1179): Launched 06:16:31.423436 tst cs_paging_gprs_active.py:38: start network... 06:16:31.640796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:32.148091 run create_hlr_db(pid=1180): Launched 06:16:32.286796 bus /sierra_2: Setting Powered False 06:16:33.345860 run create_hlr_db(pid=1180): Terminated: ok {rc=0} 06:16:33.759165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1182): Launched 06:16:34.054138 run osmo-hlr_10.42.42.2(pid=1183): Launched 06:16:34.166789 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:34.676088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1185): Launched 06:16:34.972047 run osmo-stp_10.42.42.5(pid=1186): Launched 06:16:35.084768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:35.596788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1188): Launched 06:16:35.710047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:35.959639 run patchelf(pid=1189): Launched 06:16:36.123846 run osmo-stp_10.42.42.5(pid=1186): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1186)] 06:16:36.249352 run osmo-stp_10.42.42.5(pid=1186): stdout: | (launched: 2022-12-09_06:16:34.918034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:36.376066 run osmo-stp_10.42.42.5(pid=1186): stderr: | 20221209061635086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061635086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061635087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061635087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061635087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061635088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061635088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:36.503976 run osmo-stp_10.42.42.5(pid=1186): stdout: | (launched: 2022-12-09_06:16:34.918034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:36.625376 run osmo-stp_10.42.42.5(pid=1186): stderr: | 20221209061635086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061635086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061635087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061635087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061635087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061635088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061635088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:36.769367 run patchelf(pid=1189): Terminating (SIGINT) 06:16:36.935546 run patchelf(pid=1189): Terminated: ok {rc=0} 06:16:37.055829 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1186): Process ended prematurely: osmo-stp_10.42.42.5(pid=1186) [trial-2355↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1186)] [trial-2355↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 06:16:37.065137 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:16:37.092874 run osmo-hlr_10.42.42.2(pid=1183): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1183)] 06:16:37.141228 run osmo-hlr_10.42.42.2(pid=1183): stdout: | (launched: 2022-12-09_06:16:34.000217) 06:16:37.190987 run osmo-hlr_10.42.42.2(pid=1183): stderr: | 20221209061634175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061634175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061634175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061634175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061634175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061634175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061634187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061634195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061634195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061634195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:37.241207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Terminating (SIGTERM) 06:16:37.281423 run iperf3-srv_10.42.42.10(pid=1177): Terminating (SIGTERM) 06:16:37.321583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1178): Terminating (SIGTERM) 06:16:37.361958 run iperf3-srv_10.42.42.10(pid=1179): Terminating (SIGTERM) 06:16:37.401949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1182): Terminating (SIGTERM) 06:16:37.441926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1185): Terminating (SIGTERM) 06:16:37.481985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1188): Terminating (SIGTERM) 06:16:37.522279 --- ParallelTerminationStrategy: PID 1176 died... 06:16:37.541366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Terminated: ok {rc=0} 06:16:37.585970 --- ParallelTerminationStrategy: PID 1177 died... 06:16:37.604543 run iperf3-srv_10.42.42.10(pid=1177): Terminated {rc=256} 06:16:37.649068 --- ParallelTerminationStrategy: PID 1178 died... 06:16:37.667598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1178): Terminated: ok {rc=0} 06:16:37.712075 --- ParallelTerminationStrategy: PID 1179 died... 06:16:37.730662 run iperf3-srv_10.42.42.10(pid=1179): Terminated {rc=256} 06:16:37.774877 --- ParallelTerminationStrategy: PID 1182 died... 06:16:37.793622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1182): Terminated: ok {rc=0} 06:16:37.838446 --- ParallelTerminationStrategy: PID 1185 died... 06:16:37.857124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1185): Terminated: ok {rc=0} 06:16:37.902067 --- ParallelTerminationStrategy: PID 1188 died... 06:16:37.920650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1188): Terminated: ok {rc=0} 06:16:38.006300 bus /gobi_0: Setting Powered False 06:16:39.106835 bus /gobi_0: Setting Powered False 06:16:40.222410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms iperf3.py ---------------------------------------------- 06:16:41.367284 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.378485 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:41.429563 tst iperf3.py: using LAC 19506 06:16:41.555123 tst iperf3.py: using RAC 126 06:16:41.680814 tst iperf3.py: using CellId 19506 06:16:41.804538 tst iperf3.py: using BVCI 19507 06:16:41.919657 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.930817 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.941510 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.952134 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.962720 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.973246 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.984029 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:41.994728 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:42.006216 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:42.124699 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:16:42.338868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:42.659380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1190): Launched 06:16:42.935948 run iperf3-srv_10.42.42.10(pid=1191): Launched 06:16:43.055094 tst iperf3.py:8: start network... 06:16:43.268789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:43.760718 run create_hlr_db(pid=1192): Launched 06:16:43.889804 bus /gobi_6: Setting Powered False 06:16:44.953245 run create_hlr_db(pid=1192): Terminated: ok {rc=0} 06:16:45.376690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Launched 06:16:45.673625 run osmo-hlr_10.42.42.2(pid=1195): Launched 06:16:45.786631 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:46.397651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Launched 06:16:46.711020 run osmo-stp_10.42.42.5(pid=1198): Launched 06:16:46.954624 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:47.629574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1200): Launched 06:16:47.743007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:16:47.991874 run patchelf(pid=1201): Launched 06:16:48.156307 run osmo-stp_10.42.42.5(pid=1198): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] 06:16:48.282507 run osmo-stp_10.42.42.5(pid=1198): stdout: | (launched: 2022-12-09_06:16:46.649839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:48.409958 run osmo-stp_10.42.42.5(pid=1198): stderr: | 20221209061647024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061647024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061647025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061647027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061647028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061647028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061647028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:48.538191 run osmo-stp_10.42.42.5(pid=1198): stdout: | (launched: 2022-12-09_06:16:46.649839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:16:48.660830 run osmo-stp_10.42.42.5(pid=1198): stderr: | 20221209061647024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061647024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061647025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061647027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061647028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061647028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061647028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:16:48.805811 run patchelf(pid=1201): Terminating (SIGINT) 06:16:48.973421 run patchelf(pid=1201): Terminated: ok {rc=0} 06:16:49.093718 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1198): Process ended prematurely: osmo-stp_10.42.42.5(pid=1198) [trial-2355↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] [trial-2355↪gprs:trx-lms↪iperf3.py:8] 06:16:49.102945 tst iperf3.py:8: Test FAILED (7.8 sec) 06:16:49.130325 run osmo-hlr_10.42.42.2(pid=1195): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1195)] 06:16:49.178243 run osmo-hlr_10.42.42.2(pid=1195): stdout: | (launched: 2022-12-09_06:16:45.619653) 06:16:49.228073 run osmo-hlr_10.42.42.2(pid=1195): stderr: | 20221209061645795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061645795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061645795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061645795 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061645795 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061645795 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061645807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061645817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061645818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061645818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:16:49.278097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1190): Terminating (SIGTERM) 06:16:49.318164 run iperf3-srv_10.42.42.10(pid=1191): Terminating (SIGTERM) 06:16:49.358063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Terminating (SIGTERM) 06:16:49.397992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Terminating (SIGTERM) 06:16:49.437840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1200): Terminating (SIGTERM) 06:16:49.478151 --- ParallelTerminationStrategy: PID 1190 died... 06:16:49.497188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1190): Terminated: ok {rc=0} 06:16:49.541731 --- ParallelTerminationStrategy: PID 1191 died... 06:16:49.560183 run iperf3-srv_10.42.42.10(pid=1191): Terminated {rc=256} 06:16:49.604556 --- ParallelTerminationStrategy: PID 1194 died... 06:16:49.623114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1194): Terminated: ok {rc=0} 06:16:49.667343 --- ParallelTerminationStrategy: PID 1197 died... 06:16:49.685945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1197): Terminated: ok {rc=0} 06:16:49.730363 --- ParallelTerminationStrategy: PID 1200 died... 06:16:49.748881 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1200): Terminated: ok {rc=0} 06:16:49.835050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms iperf3m4.py ---------------------------------------------- 06:16:50.981230 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:50.992041 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:16:51.038723 tst iperf3m4.py: using LAC 19507 06:16:51.158399 tst iperf3m4.py: using RAC 127 06:16:51.273162 tst iperf3m4.py: using CellId 19507 06:16:51.387721 tst iperf3m4.py: using BVCI 19508 06:16:51.495191 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.505704 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.515839 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.526256 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.536518 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.546855 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.557463 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.567835 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:16:51.578369 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:51.695730 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:51.814239 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:51.933168 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:16:52.051795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:16:52.265919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:52.583326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Launched 06:16:52.857937 run iperf3-srv_10.42.42.10(pid=1203): Launched 06:16:52.976283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:16:53.189048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:53.505640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Launched 06:16:53.779903 run iperf3-srv_10.42.42.10(pid=1205): Launched 06:16:53.898677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:16:54.111789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:54.428895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Launched 06:16:54.704246 run iperf3-srv_10.42.42.10(pid=1207): Launched 06:16:54.822629 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:16:55.035045 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:16:55.351610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1208): Launched 06:16:55.626020 run iperf3-srv_10.42.42.10(pid=1209): Launched 06:16:55.744327 tst iperf3m4.py:8: start network... 06:16:55.956659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:16:56.446244 run create_hlr_db(pid=1210): Launched 06:16:56.574612 bus /gobi_6: Setting Powered False 06:16:57.637674 run create_hlr_db(pid=1210): Terminated: ok {rc=0} 06:16:58.059356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1212): Launched 06:16:58.354374 run osmo-hlr_10.42.42.2(pid=1213): Launched 06:16:58.466841 run osmo-stp_10.42.42.5: Starting osmo-stp 06:16:58.989532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1215): Launched 06:16:59.283105 run osmo-stp_10.42.42.5(pid=1216): Launched 06:16:59.395572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:16:59.902333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1218): Launched 06:17:00.014290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:00.262217 run patchelf(pid=1219): Launched 06:17:00.425966 run osmo-stp_10.42.42.5(pid=1216): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1216)] 06:17:00.551641 run osmo-stp_10.42.42.5(pid=1216): stdout: | (launched: 2022-12-09_06:16:59.229807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:00.679215 run osmo-stp_10.42.42.5(pid=1216): stderr: | 20221209061659396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061659397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061659397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061659397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061659398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061659398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061659398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:00.805985 run osmo-stp_10.42.42.5(pid=1216): stdout: | (launched: 2022-12-09_06:16:59.229807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:00.941612 run osmo-stp_10.42.42.5(pid=1216): stderr: | 20221209061659396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061659397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061659397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061659397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061659398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061659398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061659398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:01.088523 run patchelf(pid=1219): Terminating (SIGINT) 06:17:01.258056 run patchelf(pid=1219): Terminated: ok {rc=0} 06:17:01.381592 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1216): Process ended prematurely: osmo-stp_10.42.42.5(pid=1216) [trial-2355↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1216)] [trial-2355↪gprs:trx-lms↪iperf3m4.py:8] 06:17:01.391954 tst iperf3m4.py:8: Test FAILED (10.4 sec) 06:17:01.422605 run osmo-hlr_10.42.42.2(pid=1213): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1213)] 06:17:01.472940 run osmo-hlr_10.42.42.2(pid=1213): stdout: | (launched: 2022-12-09_06:16:58.300682) 06:17:01.524852 run osmo-hlr_10.42.42.2(pid=1213): stderr: | 20221209061658474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061658474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061658474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061658474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061658474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061658474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061658488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061658496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061658497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061658497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:01.576883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Terminating (SIGTERM) 06:17:01.619966 run iperf3-srv_10.42.42.10(pid=1203): Terminating (SIGTERM) 06:17:01.664932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Terminating (SIGTERM) 06:17:01.708000 run iperf3-srv_10.42.42.10(pid=1205): Terminating (SIGTERM) 06:17:01.752674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Terminating (SIGTERM) 06:17:01.795794 run iperf3-srv_10.42.42.10(pid=1207): Terminating (SIGTERM) 06:17:01.841105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1208): Terminating (SIGTERM) 06:17:01.884471 run iperf3-srv_10.42.42.10(pid=1209): Terminating (SIGTERM) 06:17:01.929338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1212): Terminating (SIGTERM) 06:17:01.971757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1215): Terminating (SIGTERM) 06:17:02.024130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1218): Terminating (SIGTERM) 06:17:02.069201 --- ParallelTerminationStrategy: PID 1202 died... 06:17:02.088610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Terminated: ok {rc=0} 06:17:02.135867 --- ParallelTerminationStrategy: PID 1203 died... 06:17:02.155227 run iperf3-srv_10.42.42.10(pid=1203): Terminated {rc=256} 06:17:02.202032 --- ParallelTerminationStrategy: PID 1204 died... 06:17:02.221478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Terminated: ok {rc=0} 06:17:02.267721 --- ParallelTerminationStrategy: PID 1205 died... 06:17:02.286157 run iperf3-srv_10.42.42.10(pid=1205): Terminated {rc=256} 06:17:02.330128 --- ParallelTerminationStrategy: PID 1206 died... 06:17:02.348461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Terminated: ok {rc=0} 06:17:02.393025 --- ParallelTerminationStrategy: PID 1207 died... 06:17:02.427664 run iperf3-srv_10.42.42.10(pid=1207): Terminated {rc=256} 06:17:02.480915 --- ParallelTerminationStrategy: PID 1208 died... 06:17:02.499364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1208): Terminated: ok {rc=0} 06:17:02.543615 --- ParallelTerminationStrategy: PID 1209 died... 06:17:02.561984 run iperf3-srv_10.42.42.10(pid=1209): Terminated {rc=256} 06:17:02.606252 --- ParallelTerminationStrategy: PID 1212 died... 06:17:02.624999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1212): Terminated: ok {rc=0} 06:17:02.669173 --- ParallelTerminationStrategy: PID 1215 died... 06:17:02.687632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1215): Terminated: ok {rc=0} 06:17:02.731774 --- ParallelTerminationStrategy: PID 1218 died... 06:17:02.750383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1218): Terminated: ok {rc=0} 06:17:02.835431 bus /gobi_4: Setting Powered False 06:17:03.934721 bus /gobi_4: Setting Powered False 06:17:05.048672 bus /gobi_1: Setting Powered False 06:17:06.142366 bus /gobi_1: Setting Powered False 06:17:07.256493 bus /gobi_0: Setting Powered False 06:17:08.353591 bus /gobi_0: Setting Powered False 06:17:09.469072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms ping.py ---------------------------------------------- 06:17:10.570637 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:10.581559 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:17:10.630554 tst ping.py: using LAC 19508 06:17:10.745268 tst ping.py: using RAC 128 06:17:10.867983 tst ping.py: using CellId 19508 06:17:10.989048 tst ping.py: using BVCI 19509 06:17:11.101593 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.112621 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.123582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.135101 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.146458 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.157558 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.168817 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:11.180118 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:11.294703 tst ping.py:19: start network... 06:17:11.487336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:11.931567 run create_hlr_db(pid=1223): Launched 06:17:12.041301 bus /gobi_6: Setting Powered False 06:17:13.099776 run create_hlr_db(pid=1223): Terminated: ok {rc=0} 06:17:13.523732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1225): Launched 06:17:13.832155 run osmo-hlr_10.42.42.2(pid=1226): Launched 06:17:13.949791 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:14.485454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1228): Launched 06:17:14.795995 run osmo-stp_10.42.42.5(pid=1229): Launched 06:17:14.913664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:15.446165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1232): Launched 06:17:15.565102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:15.825617 run patchelf(pid=1233): Launched 06:17:16.019465 run osmo-stp_10.42.42.5(pid=1229): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1229)] 06:17:16.150402 run osmo-stp_10.42.42.5(pid=1229): stdout: | (launched: 2022-12-09_06:17:14.739735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:16.281273 run osmo-stp_10.42.42.5(pid=1229): stderr: | 20221209061714931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061714931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061714931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061714932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061714932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061714932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061714932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:16.413749 run osmo-stp_10.42.42.5(pid=1229): stdout: | (launched: 2022-12-09_06:17:14.739735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:16.541080 run osmo-stp_10.42.42.5(pid=1229): stderr: | 20221209061714931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061714931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061714931 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061714932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061714932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061714932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061714932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:16.689964 run patchelf(pid=1233): Terminating (SIGINT) 06:17:16.863253 run patchelf(pid=1233): Terminated: ok {rc=0} 06:17:16.987748 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1229): Process ended prematurely: osmo-stp_10.42.42.5(pid=1229) [trial-2355↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1229)] [trial-2355↪gprs:trx-lms↪ping.py:22] 06:17:16.997858 tst ping.py:22: Test FAILED (6.4 sec) 06:17:17.028502 run osmo-hlr_10.42.42.2(pid=1226): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1226)] 06:17:17.079918 run osmo-hlr_10.42.42.2(pid=1226): stdout: | (launched: 2022-12-09_06:17:13.776630) 06:17:17.134778 run osmo-hlr_10.42.42.2(pid=1226): stderr: | 20221209061713973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061713973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061713973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061713973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061713973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061713973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061713985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061713995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061713996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061713996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:17.186850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1225): Terminating (SIGTERM) 06:17:17.227061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1228): Terminating (SIGTERM) 06:17:17.267248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1232): Terminating (SIGTERM) 06:17:17.307522 --- ParallelTerminationStrategy: PID 1225 died... 06:17:17.326681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1225): Terminated: ok {rc=0} 06:17:17.371448 --- ParallelTerminationStrategy: PID 1228 died... 06:17:17.390115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1228): Terminated: ok {rc=0} 06:17:17.435330 --- ParallelTerminationStrategy: PID 1232 died... 06:17:17.454172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1232): Terminated: ok {rc=0} 06:17:17.540611 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 06:17:18.628118 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:18.639093 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 06:17:18.688112 tst ping_idle_ping.py: using LAC 19509 06:17:18.803514 tst ping_idle_ping.py: using RAC 129 06:17:18.926123 tst ping_idle_ping.py: using CellId 19509 06:17:19.047677 tst ping_idle_ping.py: using BVCI 19510 06:17:19.160104 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.171164 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.182189 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.193065 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.203630 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.214350 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.225103 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 06:17:19.235826 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 06:17:19.349085 tst ping_idle_ping.py:24: start network... 06:17:19.543003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:19.993213 run create_hlr_db(pid=1234): Launched 06:17:20.105247 bus /gobi_6: Setting Powered False 06:17:21.163568 run create_hlr_db(pid=1234): Terminated: ok {rc=0} 06:17:21.569615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1236): Launched 06:17:21.860367 run osmo-hlr_10.42.42.2(pid=1237): Launched 06:17:21.971125 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:22.472392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1239): Launched 06:17:22.763285 run osmo-stp_10.42.42.5(pid=1240): Launched 06:17:22.874178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:23.372727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1242): Launched 06:17:23.483722 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:23.729504 run patchelf(pid=1243): Launched 06:17:23.891564 run osmo-stp_10.42.42.5(pid=1240): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1240)] 06:17:24.014953 run osmo-stp_10.42.42.5(pid=1240): stdout: | (launched: 2022-12-09_06:17:22.710087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:24.139950 run osmo-stp_10.42.42.5(pid=1240): stderr: | 20221209061722877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061722877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061722877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061722878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061722880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061722880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061722880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:24.265074 run osmo-stp_10.42.42.5(pid=1240): stdout: | (launched: 2022-12-09_06:17:22.710087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:24.384139 run osmo-stp_10.42.42.5(pid=1240): stderr: | 20221209061722877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061722877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061722877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061722878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061722880 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061722880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061722880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:24.525227 run patchelf(pid=1243): Terminating (SIGINT) 06:17:24.688790 run patchelf(pid=1243): Terminated: ok {rc=0} 06:17:24.806943 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1240): Process ended prematurely: osmo-stp_10.42.42.5(pid=1240) [trial-2355↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1240)] [trial-2355↪gprs:trx-lms↪ping_idle_ping.py:27] 06:17:24.815559 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 06:17:24.842443 run osmo-hlr_10.42.42.2(pid=1237): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1237)] 06:17:24.889742 run osmo-hlr_10.42.42.2(pid=1237): stdout: | (launched: 2022-12-09_06:17:21.807182) 06:17:24.939046 run osmo-hlr_10.42.42.2(pid=1237): stderr: | 20221209061721981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061721982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061721982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061721982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061721982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061721982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061721994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061722002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061722002 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061722002 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:24.988616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1236): Terminating (SIGTERM) 06:17:25.028323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1239): Terminating (SIGTERM) 06:17:25.068047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1242): Terminating (SIGTERM) 06:17:25.107988 --- ParallelTerminationStrategy: PID 1236 died... 06:17:25.126912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1236): Terminated: ok {rc=0} 06:17:25.171607 --- ParallelTerminationStrategy: PID 1239 died... 06:17:25.190031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1239): Terminated: ok {rc=0} 06:17:25.234478 --- ParallelTerminationStrategy: PID 1242 died... 06:17:25.252916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1242): Terminated: ok {rc=0} 06:17:25.336343 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 06:17:26.627315 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:17:26.632366 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:17:26.664939 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:17:26.702729 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:17:26.787240 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:17:26.819775 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:17:26.857735 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:17:27.447546 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:17:27.495711 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:27.506471 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:27.555714 tst cs_paging_gprs_active.py: using LAC 19510 06:17:27.676646 tst cs_paging_gprs_active.py: using RAC 130 06:17:27.791664 tst cs_paging_gprs_active.py: using CellId 19510 06:17:27.907230 tst cs_paging_gprs_active.py: using BVCI 19511 06:17:28.014893 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.025596 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.035884 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.046542 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.057092 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.067781 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.078598 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.089184 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:28.099888 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:28.217049 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:28.332119 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:17:28.530585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:28.828286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Launched 06:17:29.085777 run iperf3-srv_10.42.42.10(pid=1249): Launched 06:17:29.196657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:17:29.393643 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:29.689956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1250): Launched 06:17:29.946964 run iperf3-srv_10.42.42.10(pid=1251): Launched 06:17:30.057535 tst cs_paging_gprs_active.py:38: start network... 06:17:30.254397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:30.712397 run create_hlr_db(pid=1252): Launched 06:17:30.824881 bus /gobi_6: Setting Powered False 06:17:31.882214 run create_hlr_db(pid=1252): Terminated: ok {rc=0} 06:17:32.315398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1254): Launched 06:17:32.616100 run osmo-hlr_10.42.42.2(pid=1255): Launched 06:17:32.729266 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:33.257415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1257): Launched 06:17:33.553157 run osmo-stp_10.42.42.5(pid=1258): Launched 06:17:33.666118 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:34.175484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1260): Launched 06:17:34.287913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:34.535888 run patchelf(pid=1261): Launched 06:17:34.701113 run osmo-stp_10.42.42.5(pid=1258): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1258)] 06:17:34.826795 run osmo-stp_10.42.42.5(pid=1258): stdout: | (launched: 2022-12-09_06:17:33.499111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:34.954358 run osmo-stp_10.42.42.5(pid=1258): stderr: | 20221209061733668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061733668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061733668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061733669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061733669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061733669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061733669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:35.081899 run osmo-stp_10.42.42.5(pid=1258): stdout: | (launched: 2022-12-09_06:17:33.499111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:35.203880 run osmo-stp_10.42.42.5(pid=1258): stderr: | 20221209061733668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061733668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061733668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061733669 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061733669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061733669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061733669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:35.348751 run patchelf(pid=1261): Terminating (SIGINT) 06:17:35.515220 run patchelf(pid=1261): Terminated: ok {rc=0} 06:17:35.635415 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1258): Process ended prematurely: osmo-stp_10.42.42.5(pid=1258) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1258)] [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:17:35.644675 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 06:17:35.671791 run osmo-hlr_10.42.42.2(pid=1255): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1255)] 06:17:35.719624 run osmo-hlr_10.42.42.2(pid=1255): stdout: | (launched: 2022-12-09_06:17:32.561650) 06:17:35.769245 run osmo-hlr_10.42.42.2(pid=1255): stderr: | 20221209061732738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061732738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061732738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061732738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061732738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061732738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061732749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061732757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061732758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061732758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:35.819710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Terminating (SIGTERM) 06:17:35.859340 run iperf3-srv_10.42.42.10(pid=1249): Terminating (SIGTERM) 06:17:35.898649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1250): Terminating (SIGTERM) 06:17:35.938169 run iperf3-srv_10.42.42.10(pid=1251): Terminating (SIGTERM) 06:17:35.977734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1254): Terminating (SIGTERM) 06:17:36.017282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1257): Terminating (SIGTERM) 06:17:36.056909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1260): Terminating (SIGTERM) 06:17:36.096716 --- ParallelTerminationStrategy: PID 1248 died... 06:17:36.115775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Terminated: ok {rc=0} 06:17:36.160307 --- ParallelTerminationStrategy: PID 1249 died... 06:17:36.178491 run iperf3-srv_10.42.42.10(pid=1249): Terminated {rc=256} 06:17:36.222542 --- ParallelTerminationStrategy: PID 1250 died... 06:17:36.240856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1250): Terminated: ok {rc=0} 06:17:36.284788 --- ParallelTerminationStrategy: PID 1251 died... 06:17:36.303199 run iperf3-srv_10.42.42.10(pid=1251): Terminated {rc=256} 06:17:36.347055 --- ParallelTerminationStrategy: PID 1254 died... 06:17:36.365503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1254): Terminated: ok {rc=0} 06:17:36.409853 --- ParallelTerminationStrategy: PID 1257 died... 06:17:36.428270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1257): Terminated: ok {rc=0} 06:17:36.472785 --- ParallelTerminationStrategy: PID 1260 died... 06:17:36.491324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1260): Terminated: ok {rc=0} 06:17:36.574045 bus /gobi_0: Setting Powered False 06:17:37.669830 bus /gobi_0: Setting Powered False 06:17:38.782377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:17:39.926516 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:39.937831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:39.995746 tst iperf3.py: using LAC 19511 06:17:40.124672 tst iperf3.py: using RAC 131 06:17:40.241882 tst iperf3.py: using CellId 19511 06:17:40.360729 tst iperf3.py: using BVCI 19512 06:17:40.468739 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.479451 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.489971 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.501152 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.512109 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.523219 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.534516 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.545581 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:40.556764 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:40.672938 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:40.873384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:41.170706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Launched 06:17:41.428032 run iperf3-srv_10.42.42.10(pid=1266): Launched 06:17:41.539124 tst iperf3.py:8: start network... 06:17:41.736329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:42.192126 run create_hlr_db(pid=1267): Launched 06:17:42.303584 bus /gobi_6: Setting Powered False 06:17:43.362753 run create_hlr_db(pid=1267): Terminated: ok {rc=0} 06:17:43.775390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Launched 06:17:44.070392 run osmo-hlr_10.42.42.2(pid=1270): Launched 06:17:44.183263 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:44.688878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Launched 06:17:44.982774 run osmo-stp_10.42.42.5(pid=1273): Launched 06:17:45.095048 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:45.603271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Launched 06:17:45.715674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:45.977756 run patchelf(pid=1276): Launched 06:17:46.190375 run osmo-stp_10.42.42.5(pid=1273): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] 06:17:46.330499 run osmo-stp_10.42.42.5(pid=1273): stdout: | (launched: 2022-12-09_06:17:44.928856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:46.471473 run osmo-stp_10.42.42.5(pid=1273): stderr: | 20221209061745097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061745097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061745097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061745098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061745098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061745098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061745098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:46.613257 run osmo-stp_10.42.42.5(pid=1273): stdout: | (launched: 2022-12-09_06:17:44.928856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:46.749165 run osmo-stp_10.42.42.5(pid=1273): stderr: | 20221209061745097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061745097 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061745097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061745098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061745098 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061745098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061745098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:46.907769 run patchelf(pid=1276): Terminating (SIGINT) 06:17:47.090800 run patchelf(pid=1276): Terminated: ok {rc=0} 06:17:47.221854 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1273): Process ended prematurely: osmo-stp_10.42.42.5(pid=1273) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 06:17:47.231726 tst iperf3.py:8: Test FAILED (7.3 sec) 06:17:47.260292 run osmo-hlr_10.42.42.2(pid=1270): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1270)] 06:17:47.310835 run osmo-hlr_10.42.42.2(pid=1270): stdout: | (launched: 2022-12-09_06:17:44.016482) 06:17:47.362926 run osmo-hlr_10.42.42.2(pid=1270): stderr: | 20221209061744191 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061744191 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061744192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061744192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061744192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061744192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061744203 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061744212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061744212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061744212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:47.415606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Terminating (SIGTERM) 06:17:47.457803 run iperf3-srv_10.42.42.10(pid=1266): Terminating (SIGTERM) 06:17:47.500139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Terminating (SIGTERM) 06:17:47.542400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Terminating (SIGTERM) 06:17:47.584297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Terminating (SIGTERM) 06:17:47.626544 --- ParallelTerminationStrategy: PID 1265 died... 06:17:47.646619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Terminated: ok {rc=0} 06:17:47.693184 --- ParallelTerminationStrategy: PID 1266 died... 06:17:47.712706 run iperf3-srv_10.42.42.10(pid=1266): Terminated {rc=256} 06:17:47.758950 --- ParallelTerminationStrategy: PID 1269 died... 06:17:47.778589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1269): Terminated: ok {rc=0} 06:17:47.824769 --- ParallelTerminationStrategy: PID 1272 died... 06:17:47.844307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1272): Terminated: ok {rc=0} 06:17:47.890653 --- ParallelTerminationStrategy: PID 1275 died... 06:17:47.910310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1275): Terminated: ok {rc=0} 06:17:47.998321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:17:49.146160 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.157926 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:17:49.211892 tst iperf3m4.py: using LAC 19512 06:17:49.337572 tst iperf3m4.py: using RAC 132 06:17:49.463320 tst iperf3m4.py: using CellId 19512 06:17:49.579627 tst iperf3m4.py: using BVCI 19513 06:17:49.688904 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.699745 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.710290 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.721806 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.732482 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.743243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.754308 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.764796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:17:49.775592 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:49.893399 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:50.009509 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:50.126641 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:17:50.247303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:17:50.461499 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:50.780120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Launched 06:17:51.056018 run iperf3-srv_10.42.42.10(pid=1278): Launched 06:17:51.174796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:17:51.387959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:51.705719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1279): Launched 06:17:51.979683 run iperf3-srv_10.42.42.10(pid=1280): Launched 06:17:52.098321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:17:52.310874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:52.628276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1281): Launched 06:17:52.902896 run iperf3-srv_10.42.42.10(pid=1282): Launched 06:17:53.021236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:17:53.233919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:17:53.551291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1283): Launched 06:17:53.825358 run iperf3-srv_10.42.42.10(pid=1284): Launched 06:17:53.943813 tst iperf3m4.py:8: start network... 06:17:54.155955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:17:54.646105 run create_hlr_db(pid=1285): Launched 06:17:54.773939 bus /gobi_6: Setting Powered False 06:17:55.837564 run create_hlr_db(pid=1285): Terminated: ok {rc=0} 06:17:56.258798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1287): Launched 06:17:56.552802 run osmo-hlr_10.42.42.2(pid=1288): Launched 06:17:56.665196 run osmo-stp_10.42.42.5: Starting osmo-stp 06:17:57.189037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1290): Launched 06:17:57.483146 run osmo-stp_10.42.42.5(pid=1291): Launched 06:17:57.595698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:17:58.102997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1293): Launched 06:17:58.215819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:17:58.464703 run patchelf(pid=1294): Launched 06:17:58.629442 run osmo-stp_10.42.42.5(pid=1291): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1291)] 06:17:58.755440 run osmo-stp_10.42.42.5(pid=1291): stdout: | (launched: 2022-12-09_06:17:57.429236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:58.882747 run osmo-stp_10.42.42.5(pid=1291): stderr: | 20221209061757595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061757595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061757595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061757596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061757596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061757596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061757596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:59.010018 run osmo-stp_10.42.42.5(pid=1291): stdout: | (launched: 2022-12-09_06:17:57.429236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:17:59.133332 run osmo-stp_10.42.42.5(pid=1291): stderr: | 20221209061757595 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061757595 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061757595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061757596 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061757596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061757596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061757596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:17:59.277960 run patchelf(pid=1294): Terminating (SIGINT) 06:17:59.444624 run patchelf(pid=1294): Terminated: ok {rc=0} 06:17:59.564552 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1291): Process ended prematurely: osmo-stp_10.42.42.5(pid=1291) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1291)] [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 06:17:59.573864 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:17:59.601275 run osmo-hlr_10.42.42.2(pid=1288): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1288)] 06:17:59.649606 run osmo-hlr_10.42.42.2(pid=1288): stdout: | (launched: 2022-12-09_06:17:56.499112) 06:17:59.699425 run osmo-hlr_10.42.42.2(pid=1288): stderr: | 20221209061756670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061756670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061756670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061756670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061756670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061756670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061756682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061756691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061756691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061756691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:17:59.749804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Terminating (SIGTERM) 06:17:59.790308 run iperf3-srv_10.42.42.10(pid=1278): Terminating (SIGTERM) 06:17:59.830670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1279): Terminating (SIGTERM) 06:17:59.871173 run iperf3-srv_10.42.42.10(pid=1280): Terminating (SIGTERM) 06:17:59.911602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1281): Terminating (SIGTERM) 06:17:59.952095 run iperf3-srv_10.42.42.10(pid=1282): Terminating (SIGTERM) 06:17:59.992324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1283): Terminating (SIGTERM) 06:18:00.032720 run iperf3-srv_10.42.42.10(pid=1284): Terminating (SIGTERM) 06:18:00.072983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1287): Terminating (SIGTERM) 06:18:00.113563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1290): Terminating (SIGTERM) 06:18:00.153894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1293): Terminating (SIGTERM) 06:18:00.194507 --- ParallelTerminationStrategy: PID 1277 died... 06:18:00.213666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1277): Terminated: ok {rc=0} 06:18:00.258560 --- ParallelTerminationStrategy: PID 1278 died... 06:18:00.277487 run iperf3-srv_10.42.42.10(pid=1278): Terminated {rc=256} 06:18:00.322597 --- ParallelTerminationStrategy: PID 1279 died... 06:18:00.341485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1279): Terminated: ok {rc=0} 06:18:00.385934 --- ParallelTerminationStrategy: PID 1280 died... 06:18:00.404821 run iperf3-srv_10.42.42.10(pid=1280): Terminated {rc=256} 06:18:00.449533 --- ParallelTerminationStrategy: PID 1281 died... 06:18:00.468393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1281): Terminated: ok {rc=0} 06:18:00.513202 --- ParallelTerminationStrategy: PID 1282 died... 06:18:00.531987 run iperf3-srv_10.42.42.10(pid=1282): Terminated {rc=256} 06:18:00.576654 --- ParallelTerminationStrategy: PID 1283 died... 06:18:00.595589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1283): Terminated: ok {rc=0} 06:18:00.640844 --- ParallelTerminationStrategy: PID 1284 died... 06:18:00.660001 run iperf3-srv_10.42.42.10(pid=1284): Terminated {rc=256} 06:18:00.704810 --- ParallelTerminationStrategy: PID 1287 died... 06:18:00.723878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1287): Terminated: ok {rc=0} 06:18:00.769196 --- ParallelTerminationStrategy: PID 1290 died... 06:18:00.787860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1290): Terminated: ok {rc=0} 06:18:00.836369 --- ParallelTerminationStrategy: PID 1293 died... 06:18:00.861473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1293): Terminated: ok {rc=0} 06:18:00.959381 bus /gobi_4: Setting Powered False 06:18:02.069541 bus /gobi_4: Setting Powered False 06:18:03.187735 bus /gobi_1: Setting Powered False 06:18:04.286119 bus /gobi_1: Setting Powered False 06:18:05.403319 bus /gobi_0: Setting Powered False 06:18:06.501242 bus /gobi_0: Setting Powered False 06:18:07.618444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 06:18:08.722336 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:08.734306 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:18:08.789296 tst ping.py: using LAC 19513 06:18:08.909620 tst ping.py: using RAC 133 06:18:09.029505 tst ping.py: using CellId 19513 06:18:09.149037 tst ping.py: using BVCI 19514 06:18:09.261615 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.272813 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.283817 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.294912 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.305831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.316611 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.327925 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:09.338903 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:09.450986 tst ping.py:19: start network... 06:18:09.646202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:10.094887 run create_hlr_db(pid=1295): Launched 06:18:10.205851 bus /gobi_6: Setting Powered False 06:18:11.264342 run create_hlr_db(pid=1295): Terminated: ok {rc=0} 06:18:11.690876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Launched 06:18:12.000149 run osmo-hlr_10.42.42.2(pid=1298): Launched 06:18:12.118157 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:12.653431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Launched 06:18:12.961865 run osmo-stp_10.42.42.5(pid=1301): Launched 06:18:13.079560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:13.615117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1303): Launched 06:18:13.734354 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:13.996171 run patchelf(pid=1304): Launched 06:18:14.169580 run osmo-stp_10.42.42.5(pid=1301): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] 06:18:14.301568 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-09_06:18:12.905986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:14.435185 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221209061813094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061813094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061813094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061813095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061813097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061813097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061813097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:14.569188 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-09_06:18:12.905986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:14.696559 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221209061813094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061813094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061813094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061813095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061813097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061813097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061813097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:14.847652 run patchelf(pid=1304): Terminating (SIGINT) 06:18:15.022298 run patchelf(pid=1304): Terminated: ok {rc=0} 06:18:15.147884 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 06:18:15.157144 tst ping.py:22: Test FAILED (6.4 sec) 06:18:15.184923 run osmo-hlr_10.42.42.2(pid=1298): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1298)] 06:18:15.235055 run osmo-hlr_10.42.42.2(pid=1298): stdout: | (launched: 2022-12-09_06:18:11.944107) 06:18:15.286718 run osmo-hlr_10.42.42.2(pid=1298): stderr: | 20221209061812143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061812143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061812143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061812143 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061812143 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061812143 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061812156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061812166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061812166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061812166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:15.338954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Terminating (SIGTERM) 06:18:15.380734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminating (SIGTERM) 06:18:15.422516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1303): Terminating (SIGTERM) 06:18:15.464571 --- ParallelTerminationStrategy: PID 1297 died... 06:18:15.484547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Terminated: ok {rc=0} 06:18:15.530384 --- ParallelTerminationStrategy: PID 1300 died... 06:18:15.549893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminated: ok {rc=0} 06:18:15.595333 --- ParallelTerminationStrategy: PID 1303 died... 06:18:15.614669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1303): Terminated: ok {rc=0} 06:18:15.700396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:18:16.786615 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:16.799071 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:18:16.851613 tst ping_idle_ping.py: using LAC 19514 06:18:16.976453 tst ping_idle_ping.py: using RAC 134 06:18:17.125624 tst ping_idle_ping.py: using CellId 19514 06:18:17.248742 tst ping_idle_ping.py: using BVCI 19515 06:18:17.361083 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.372258 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.383291 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.394247 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.405127 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.415942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.427027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:18:17.438097 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:18:17.554758 tst ping_idle_ping.py:24: start network... 06:18:17.764915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:18.247298 run create_hlr_db(pid=1305): Launched 06:18:18.372871 bus /gobi_6: Setting Powered False 06:18:19.434896 run create_hlr_db(pid=1305): Terminated: ok {rc=0} 06:18:19.868689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1307): Launched 06:18:20.178224 run osmo-hlr_10.42.42.2(pid=1308): Launched 06:18:20.296161 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:20.835160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1310): Launched 06:18:21.144927 run osmo-stp_10.42.42.5(pid=1311): Launched 06:18:21.264173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:21.801042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1313): Launched 06:18:21.920154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:22.182000 run patchelf(pid=1314): Launched 06:18:22.355269 run osmo-stp_10.42.42.5(pid=1311): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1311)] 06:18:22.487358 run osmo-stp_10.42.42.5(pid=1311): stdout: | (launched: 2022-12-09_06:18:21.088586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:22.621426 run osmo-stp_10.42.42.5(pid=1311): stderr: | 20221209061821277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061821277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061821277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061821278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061821278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061821278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061821278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:22.755608 run osmo-stp_10.42.42.5(pid=1311): stdout: | (launched: 2022-12-09_06:18:21.088586) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:22.883180 run osmo-stp_10.42.42.5(pid=1311): stderr: | 20221209061821277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061821277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061821277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061821278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061821278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061821278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061821278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:23.034448 run patchelf(pid=1314): Terminating (SIGINT) 06:18:23.209276 run patchelf(pid=1314): Terminated: ok {rc=0} 06:18:23.336248 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1311): Process ended prematurely: osmo-stp_10.42.42.5(pid=1311) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1311)] [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 06:18:23.345612 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 06:18:23.373512 run osmo-hlr_10.42.42.2(pid=1308): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1308)] 06:18:23.423324 run osmo-hlr_10.42.42.2(pid=1308): stdout: | (launched: 2022-12-09_06:18:20.122167) 06:18:23.474805 run osmo-hlr_10.42.42.2(pid=1308): stderr: | 20221209061820318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061820318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061820318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061820318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061820318 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061820318 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061820330 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061820339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061820339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061820339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:23.527329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1307): Terminating (SIGTERM) 06:18:23.569186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1310): Terminating (SIGTERM) 06:18:23.610987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1313): Terminating (SIGTERM) 06:18:23.653185 --- ParallelTerminationStrategy: PID 1307 died... 06:18:23.673091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1307): Terminated: ok {rc=0} 06:18:23.719268 --- ParallelTerminationStrategy: PID 1310 died... 06:18:23.738841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1310): Terminated: ok {rc=0} 06:18:23.785118 --- ParallelTerminationStrategy: PID 1313 died... 06:18:23.804674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1313): Terminated: ok {rc=0} 06:18:23.893552 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:18:25.190550 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:18:25.196310 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:18:25.230441 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:18:25.269201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:18:25.354375 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:18:25.387389 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:18:25.425746 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:18:26.015269 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:18:26.064085 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.074721 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:26.143156 tst cs_paging_gprs_active.py: using LAC 19515 06:18:26.261234 tst cs_paging_gprs_active.py: using RAC 135 06:18:26.387830 tst cs_paging_gprs_active.py: using CellId 19515 06:18:26.516792 tst cs_paging_gprs_active.py: using BVCI 19516 06:18:26.633402 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.644679 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.655805 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.667268 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.678341 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.689479 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.700584 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.711700 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:26.722951 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:26.837571 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:26.956268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:18:27.170007 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:27.489695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1318): Launched 06:18:27.765348 run iperf3-srv_10.42.42.10(pid=1319): Launched 06:18:27.884616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:18:28.097964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:28.415791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Launched 06:18:28.691795 run iperf3-srv_10.42.42.10(pid=1321): Launched 06:18:28.810777 tst cs_paging_gprs_active.py:38: start network... 06:18:29.023648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:29.515779 run create_hlr_db(pid=1322): Launched 06:18:29.644286 bus /gobi_6: Setting Powered False 06:18:30.707355 run create_hlr_db(pid=1322): Terminated: ok {rc=0} 06:18:31.179909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Launched 06:18:31.521603 run osmo-hlr_10.42.42.2(pid=1325): Launched 06:18:31.642116 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:32.302124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Launched 06:18:32.630080 run osmo-stp_10.42.42.5(pid=1328): Launched 06:18:32.750272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:33.293956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1330): Launched 06:18:33.414886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:33.688761 run patchelf(pid=1331): Launched 06:18:33.866059 run osmo-stp_10.42.42.5(pid=1328): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] 06:18:34.001093 run osmo-stp_10.42.42.5(pid=1328): stdout: | (launched: 2022-12-09_06:18:32.572647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:34.137829 run osmo-stp_10.42.42.5(pid=1328): stderr: | 20221209061832762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061832762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061832763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061832763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061832763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061832764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061832764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:34.275576 run osmo-stp_10.42.42.5(pid=1328): stdout: | (launched: 2022-12-09_06:18:32.572647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:34.406809 run osmo-stp_10.42.42.5(pid=1328): stderr: | 20221209061832762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061832762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061832763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061832763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061832763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061832764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061832764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:34.562488 run patchelf(pid=1331): Terminating (SIGINT) 06:18:34.741175 run patchelf(pid=1331): Terminated: ok {rc=0} 06:18:34.870336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1328): Process ended prematurely: osmo-stp_10.42.42.5(pid=1328) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:18:34.880264 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:18:34.908905 run osmo-hlr_10.42.42.2(pid=1325): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1325)] 06:18:34.958910 run osmo-hlr_10.42.42.2(pid=1325): stdout: | (launched: 2022-12-09_06:18:31.447681) 06:18:35.010758 run osmo-hlr_10.42.42.2(pid=1325): stderr: | 20221209061831895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061831895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061831895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061831895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061831895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061831895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061831919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061831942 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061831943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061831943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:35.063180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1318): Terminating (SIGTERM) 06:18:35.105447 run iperf3-srv_10.42.42.10(pid=1319): Terminating (SIGTERM) 06:18:35.147656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Terminating (SIGTERM) 06:18:35.189825 run iperf3-srv_10.42.42.10(pid=1321): Terminating (SIGTERM) 06:18:35.231996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Terminating (SIGTERM) 06:18:35.274242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Terminating (SIGTERM) 06:18:35.316401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1330): Terminating (SIGTERM) 06:18:35.359175 --- ParallelTerminationStrategy: PID 1318 died... 06:18:35.379602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1318): Terminated: ok {rc=0} 06:18:35.426293 --- ParallelTerminationStrategy: PID 1319 died... 06:18:35.445945 run iperf3-srv_10.42.42.10(pid=1319): Terminated {rc=256} 06:18:35.492293 --- ParallelTerminationStrategy: PID 1320 died... 06:18:35.512152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1320): Terminated: ok {rc=0} 06:18:35.558793 --- ParallelTerminationStrategy: PID 1321 died... 06:18:35.578484 run iperf3-srv_10.42.42.10(pid=1321): Terminated {rc=256} 06:18:35.624800 --- ParallelTerminationStrategy: PID 1324 died... 06:18:35.644806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1324): Terminated: ok {rc=0} 06:18:35.690988 --- ParallelTerminationStrategy: PID 1327 died... 06:18:35.710652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1327): Terminated: ok {rc=0} 06:18:35.756939 --- ParallelTerminationStrategy: PID 1330 died... 06:18:35.776633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1330): Terminated: ok {rc=0} 06:18:35.866255 bus /gobi_0: Setting Powered False 06:18:36.965254 bus /gobi_0: Setting Powered False 06:18:38.081309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:18:39.228855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.240706 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:39.310173 tst iperf3.py: using LAC 19516 06:18:39.435851 tst iperf3.py: using RAC 136 06:18:39.553416 tst iperf3.py: using CellId 19516 06:18:39.671024 tst iperf3.py: using BVCI 19517 06:18:39.778161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.788868 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.799464 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.810191 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.820866 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.831562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.842381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.853065 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:39.863839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:39.981845 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:40.197068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:40.516361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Launched 06:18:40.792352 run iperf3-srv_10.42.42.10(pid=1333): Launched 06:18:40.911889 tst iperf3.py:8: start network... 06:18:41.125670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:41.617033 run create_hlr_db(pid=1334): Launched 06:18:41.745961 bus /gobi_6: Setting Powered False 06:18:42.809303 run create_hlr_db(pid=1334): Terminated: ok {rc=0} 06:18:43.249129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Launched 06:18:43.566198 run osmo-hlr_10.42.42.2(pid=1337): Launched 06:18:43.686191 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:44.234232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Launched 06:18:44.551318 run osmo-stp_10.42.42.5(pid=1340): Launched 06:18:44.671625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:45.218121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1342): Launched 06:18:45.338704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:45.606586 run patchelf(pid=1343): Launched 06:18:45.783341 run osmo-stp_10.42.42.5(pid=1340): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] 06:18:45.919314 run osmo-stp_10.42.42.5(pid=1340): stdout: | (launched: 2022-12-09_06:18:44.492348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:46.057458 run osmo-stp_10.42.42.5(pid=1340): stderr: | 20221209061844705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061844705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061844705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061844706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061844706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061844706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061844706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:46.195775 run osmo-stp_10.42.42.5(pid=1340): stdout: | (launched: 2022-12-09_06:18:44.492348) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:46.329175 run osmo-stp_10.42.42.5(pid=1340): stderr: | 20221209061844705 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061844705 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061844705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061844706 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061844706 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061844706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061844706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:46.486983 run patchelf(pid=1343): Terminating (SIGINT) 06:18:46.667545 run patchelf(pid=1343): Terminated: ok {rc=0} 06:18:46.797803 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1340): Process ended prematurely: osmo-stp_10.42.42.5(pid=1340) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 06:18:46.808720 tst iperf3.py:8: Test FAILED (7.6 sec) 06:18:46.838341 run osmo-hlr_10.42.42.2(pid=1337): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1337)] 06:18:46.889223 run osmo-hlr_10.42.42.2(pid=1337): stdout: | (launched: 2022-12-09_06:18:43.508796) 06:18:46.941958 run osmo-hlr_10.42.42.2(pid=1337): stderr: | 20221209061843707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061843707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061843707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061843707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061843707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061843707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061843721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061843729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061843729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061843729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:46.994924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Terminating (SIGTERM) 06:18:47.037591 run iperf3-srv_10.42.42.10(pid=1333): Terminating (SIGTERM) 06:18:47.080049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Terminating (SIGTERM) 06:18:47.122724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Terminating (SIGTERM) 06:18:47.165920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1342): Terminating (SIGTERM) 06:18:47.210534 --- ParallelTerminationStrategy: PID 1332 died... 06:18:47.230655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Terminated: ok {rc=0} 06:18:47.278851 --- ParallelTerminationStrategy: PID 1333 died... 06:18:47.297687 run iperf3-srv_10.42.42.10(pid=1333): Terminated {rc=256} 06:18:47.343967 --- ParallelTerminationStrategy: PID 1336 died... 06:18:47.362981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Terminated: ok {rc=0} 06:18:47.408416 --- ParallelTerminationStrategy: PID 1339 died... 06:18:47.427297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Terminated: ok {rc=0} 06:18:47.473924 --- ParallelTerminationStrategy: PID 1342 died... 06:18:47.492737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1342): Terminated: ok {rc=0} 06:18:47.579795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:18:48.729323 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:48.740632 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:18:48.809935 tst iperf3m4.py: using LAC 19517 06:18:48.935393 tst iperf3m4.py: using RAC 137 06:18:49.060615 tst iperf3m4.py: using CellId 19517 06:18:49.185500 tst iperf3m4.py: using BVCI 19518 06:18:49.301306 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.312614 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.323932 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.335083 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.346217 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.357482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.368745 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.379846 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:18:49.391140 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:49.506852 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:49.626102 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:49.739880 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:18:49.859243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:18:50.073379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:50.391446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1344): Launched 06:18:50.667646 run iperf3-srv_10.42.42.10(pid=1345): Launched 06:18:50.787044 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:18:51.001204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:51.319128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1346): Launched 06:18:51.595620 run iperf3-srv_10.42.42.10(pid=1347): Launched 06:18:51.714624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:18:51.927698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:52.245314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1348): Launched 06:18:52.521370 run iperf3-srv_10.42.42.10(pid=1349): Launched 06:18:52.640534 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:18:52.854125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:18:53.172291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Launched 06:18:53.447610 run iperf3-srv_10.42.42.10(pid=1351): Launched 06:18:53.567547 tst iperf3m4.py:8: start network... 06:18:53.780228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:18:54.272321 run create_hlr_db(pid=1352): Launched 06:18:54.400360 bus /gobi_6: Setting Powered False 06:18:55.462736 run create_hlr_db(pid=1352): Terminated: ok {rc=0} 06:18:55.885853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Launched 06:18:56.179671 run osmo-hlr_10.42.42.2(pid=1355): Launched 06:18:56.291248 run osmo-stp_10.42.42.5: Starting osmo-stp 06:18:56.798117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Launched 06:18:57.091930 run osmo-stp_10.42.42.5(pid=1358): Launched 06:18:57.203139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:18:57.709071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Launched 06:18:57.821729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:18:58.069380 run patchelf(pid=1361): Launched 06:18:58.233116 run osmo-stp_10.42.42.5(pid=1358): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] 06:18:58.358048 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_06:18:57.038041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:58.484102 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209061857206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061857206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061857206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061857207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061857207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061857207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061857207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:58.610957 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_06:18:57.038041) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:18:58.732329 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209061857206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061857206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061857206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061857207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061857207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061857207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061857207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:18:58.876855 run patchelf(pid=1361): Terminating (SIGINT) 06:18:59.042825 run patchelf(pid=1361): Terminated: ok {rc=0} 06:18:59.162814 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:18:59.172090 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:18:59.199477 run osmo-hlr_10.42.42.2(pid=1355): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1355)] 06:18:59.247887 run osmo-hlr_10.42.42.2(pid=1355): stdout: | (launched: 2022-12-09_06:18:56.125865) 06:18:59.297286 run osmo-hlr_10.42.42.2(pid=1355): stderr: | 20221209061856297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061856297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061856297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061856297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061856297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061856297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061856313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061856322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061856322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061856322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:18:59.347387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1344): Terminating (SIGTERM) 06:18:59.387543 run iperf3-srv_10.42.42.10(pid=1345): Terminating (SIGTERM) 06:18:59.427967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1346): Terminating (SIGTERM) 06:18:59.468187 run iperf3-srv_10.42.42.10(pid=1347): Terminating (SIGTERM) 06:18:59.508321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1348): Terminating (SIGTERM) 06:18:59.548749 run iperf3-srv_10.42.42.10(pid=1349): Terminating (SIGTERM) 06:18:59.589106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Terminating (SIGTERM) 06:18:59.629263 run iperf3-srv_10.42.42.10(pid=1351): Terminating (SIGTERM) 06:18:59.669194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminating (SIGTERM) 06:18:59.709966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminating (SIGTERM) 06:18:59.750066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Terminating (SIGTERM) 06:18:59.790426 --- ParallelTerminationStrategy: PID 1344 died... 06:18:59.809566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1344): Terminated: ok {rc=0} 06:18:59.854329 --- ParallelTerminationStrategy: PID 1345 died... 06:18:59.872787 run iperf3-srv_10.42.42.10(pid=1345): Terminated {rc=256} 06:18:59.917533 --- ParallelTerminationStrategy: PID 1346 died... 06:18:59.936168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1346): Terminated: ok {rc=0} 06:18:59.980899 --- ParallelTerminationStrategy: PID 1347 died... 06:18:59.999829 run iperf3-srv_10.42.42.10(pid=1347): Terminated {rc=256} 06:19:00.044086 --- ParallelTerminationStrategy: PID 1348 died... 06:19:00.062683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1348): Terminated: ok {rc=0} 06:19:00.107324 --- ParallelTerminationStrategy: PID 1349 died... 06:19:00.125916 run iperf3-srv_10.42.42.10(pid=1349): Terminated {rc=256} 06:19:00.170061 --- ParallelTerminationStrategy: PID 1350 died... 06:19:00.188640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1350): Terminated: ok {rc=0} 06:19:00.233282 --- ParallelTerminationStrategy: PID 1351 died... 06:19:00.251798 run iperf3-srv_10.42.42.10(pid=1351): Terminated {rc=256} 06:19:00.296409 --- ParallelTerminationStrategy: PID 1354 died... 06:19:00.315132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminated: ok {rc=0} 06:19:00.359777 --- ParallelTerminationStrategy: PID 1357 died... 06:19:00.378450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminated: ok {rc=0} 06:19:00.422692 --- ParallelTerminationStrategy: PID 1360 died... 06:19:00.441530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Terminated: ok {rc=0} 06:19:00.527906 bus /gobi_4: Setting Powered False 06:19:01.631023 bus /gobi_4: Setting Powered False 06:19:02.749397 bus /gobi_1: Setting Powered False 06:19:03.848269 bus /gobi_1: Setting Powered False 06:19:04.963786 bus /gobi_0: Setting Powered False 06:19:06.061006 bus /gobi_0: Setting Powered False 06:19:07.177961 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:19:08.281775 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.293680 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:19:08.368485 tst ping.py: using LAC 19518 06:19:08.493286 tst ping.py: using RAC 138 06:19:08.615004 tst ping.py: using CellId 19518 06:19:08.736376 tst ping.py: using BVCI 19519 06:19:08.848806 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.860206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.871517 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.882724 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.893772 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.904841 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.915936 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:08.926983 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:09.039727 tst ping.py:19: start network... 06:19:09.249842 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:09.733688 run create_hlr_db(pid=1362): Launched 06:19:09.859531 bus /gobi_6: Setting Powered False 06:19:10.921599 run create_hlr_db(pid=1362): Terminated: ok {rc=0} 06:19:11.338752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Launched 06:19:11.629719 run osmo-hlr_10.42.42.2(pid=1365): Launched 06:19:11.739926 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:12.245805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Launched 06:19:12.537955 run osmo-stp_10.42.42.5(pid=1368): Launched 06:19:12.647964 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:13.147854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Launched 06:19:13.258638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:13.502702 run patchelf(pid=1371): Launched 06:19:13.665251 run osmo-stp_10.42.42.5(pid=1368): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] 06:19:13.788845 run osmo-stp_10.42.42.5(pid=1368): stdout: | (launched: 2022-12-09_06:19:12.483139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:13.913698 run osmo-stp_10.42.42.5(pid=1368): stderr: | 20221209061912652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061912652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061912652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061912653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061912655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061912655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061912655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:14.038455 run osmo-stp_10.42.42.5(pid=1368): stdout: | (launched: 2022-12-09_06:19:12.483139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:14.157792 run osmo-stp_10.42.42.5(pid=1368): stderr: | 20221209061912652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061912652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061912652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061912653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061912655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061912655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061912655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:14.298536 run patchelf(pid=1371): Terminating (SIGINT) 06:19:14.462266 run patchelf(pid=1371): Terminated: ok {rc=0} 06:19:14.580497 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1368): Process ended prematurely: osmo-stp_10.42.42.5(pid=1368) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 06:19:14.589219 tst ping.py:22: Test FAILED (6.3 sec) 06:19:14.616381 run osmo-hlr_10.42.42.2(pid=1365): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1365)] 06:19:14.664029 run osmo-hlr_10.42.42.2(pid=1365): stdout: | (launched: 2022-12-09_06:19:11.576659) 06:19:14.713365 run osmo-hlr_10.42.42.2(pid=1365): stderr: | 20221209061911752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061911752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061911752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061911753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061911753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061911753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061911766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061911774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061911774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061911774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:14.763306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminating (SIGTERM) 06:19:14.803377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Terminating (SIGTERM) 06:19:14.843609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Terminating (SIGTERM) 06:19:14.883902 --- ParallelTerminationStrategy: PID 1364 died... 06:19:14.903098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminated: ok {rc=0} 06:19:14.947643 --- ParallelTerminationStrategy: PID 1367 died... 06:19:14.966262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Terminated: ok {rc=0} 06:19:15.010629 --- ParallelTerminationStrategy: PID 1370 died... 06:19:15.029236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Terminated: ok {rc=0} 06:19:15.113498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:19:16.197586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.210289 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:19:16.282310 tst ping_idle_ping.py: using LAC 19519 06:19:16.436079 tst ping_idle_ping.py: using RAC 139 06:19:16.592468 tst ping_idle_ping.py: using CellId 19519 06:19:16.712713 tst ping_idle_ping.py: using BVCI 19520 06:19:16.858474 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.873758 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.889966 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.906055 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.922015 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.938229 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.953713 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:19:16.967802 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:19:17.114973 tst ping_idle_ping.py:24: start network... 06:19:17.331009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:17.817863 run create_hlr_db(pid=1373): Launched 06:19:17.944159 bus /gobi_6: Setting Powered False 06:19:19.002257 run create_hlr_db(pid=1373): Terminated: ok {rc=0} 06:19:19.437050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1375): Launched 06:19:19.748181 run osmo-hlr_10.42.42.2(pid=1376): Launched 06:19:19.866128 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:20.403487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1378): Launched 06:19:20.715100 run osmo-stp_10.42.42.5(pid=1379): Launched 06:19:20.832780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:21.369529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1381): Launched 06:19:21.489020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:21.753582 run patchelf(pid=1382): Launched 06:19:21.928294 run osmo-stp_10.42.42.5(pid=1379): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1379)] 06:19:22.061455 run osmo-stp_10.42.42.5(pid=1379): stdout: | (launched: 2022-12-09_06:19:20.658712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:22.196283 run osmo-stp_10.42.42.5(pid=1379): stderr: | 20221209061920848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061920848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061920848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061920849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061920849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061920849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061920849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:22.331299 run osmo-stp_10.42.42.5(pid=1379): stdout: | (launched: 2022-12-09_06:19:20.658712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:22.459744 run osmo-stp_10.42.42.5(pid=1379): stderr: | 20221209061920848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061920848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061920848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061920849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061920849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061920849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061920849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:22.612375 run patchelf(pid=1382): Terminating (SIGINT) 06:19:22.788206 run patchelf(pid=1382): Terminated: ok {rc=0} 06:19:22.914967 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1379): Process ended prematurely: osmo-stp_10.42.42.5(pid=1379) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1379)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:19:22.924159 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:19:22.951879 run osmo-hlr_10.42.42.2(pid=1376): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1376)] 06:19:23.001781 run osmo-hlr_10.42.42.2(pid=1376): stdout: | (launched: 2022-12-09_06:19:19.691331) 06:19:23.053446 run osmo-hlr_10.42.42.2(pid=1376): stderr: | 20221209061919885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061919885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061919885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061919885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061919885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061919885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061919898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061919907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061919907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061919907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:23.105482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1375): Terminating (SIGTERM) 06:19:23.147342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1378): Terminating (SIGTERM) 06:19:23.189190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1381): Terminating (SIGTERM) 06:19:23.231254 --- ParallelTerminationStrategy: PID 1375 died... 06:19:23.251302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1375): Terminated: ok {rc=0} 06:19:23.297680 --- ParallelTerminationStrategy: PID 1378 died... 06:19:23.317535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1378): Terminated: ok {rc=0} 06:19:23.363706 --- ParallelTerminationStrategy: PID 1381 died... 06:19:23.383316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1381): Terminated: ok {rc=0} 06:19:23.470974 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:19:24.772674 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:19:24.778634 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:19:24.812420 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:19:24.850987 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:19:24.935656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:19:24.968210 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:19:25.006003 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:19:25.598607 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:19:25.647072 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:25.657906 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:25.729152 tst cs_paging_gprs_active.py: using LAC 19520 06:19:25.846656 tst cs_paging_gprs_active.py: using RAC 140 06:19:25.963487 tst cs_paging_gprs_active.py: using CellId 19520 06:19:26.078481 tst cs_paging_gprs_active.py: using BVCI 19521 06:19:26.186372 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.197092 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.207649 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.218472 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.229358 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.240239 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.251322 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.262262 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:26.273369 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:26.391396 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:26.511115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:19:26.710851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:27.008602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1386): Launched 06:19:27.267484 run iperf3-srv_10.42.42.10(pid=1387): Launched 06:19:27.379115 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:19:27.577097 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:27.885998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1388): Launched 06:19:28.163550 run iperf3-srv_10.42.42.10(pid=1389): Launched 06:19:28.283382 tst cs_paging_gprs_active.py:38: start network... 06:19:28.497568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:28.991548 run create_hlr_db(pid=1390): Launched 06:19:29.120684 bus /gobi_6: Setting Powered False 06:19:30.184129 run create_hlr_db(pid=1390): Terminated: ok {rc=0} 06:19:30.615731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1392): Launched 06:19:30.950415 run osmo-hlr_10.42.42.2(pid=1393): Launched 06:19:31.198493 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:31.860529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1395): Launched 06:19:32.195691 run osmo-stp_10.42.42.5(pid=1396): Launched 06:19:32.366015 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:32.930288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1398): Launched 06:19:33.051691 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:33.320154 run patchelf(pid=1399): Launched 06:19:33.498864 run osmo-stp_10.42.42.5(pid=1396): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1396)] 06:19:33.634310 run osmo-stp_10.42.42.5(pid=1396): stdout: | (launched: 2022-12-09_06:19:32.129118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:33.771359 run osmo-stp_10.42.42.5(pid=1396): stderr: | 20221209061932450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061932450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061932450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061932451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061932451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061932451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061932451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:33.908539 run osmo-stp_10.42.42.5(pid=1396): stdout: | (launched: 2022-12-09_06:19:32.129118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:34.039378 run osmo-stp_10.42.42.5(pid=1396): stderr: | 20221209061932450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061932450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061932450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061932451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061932451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061932451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061932451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:34.194439 run patchelf(pid=1399): Terminating (SIGINT) 06:19:34.372630 run patchelf(pid=1399): Terminated: ok {rc=0} 06:19:34.501253 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1396): Process ended prematurely: osmo-stp_10.42.42.5(pid=1396) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1396)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:19:34.511207 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:19:34.539847 run osmo-hlr_10.42.42.2(pid=1393): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1393)] 06:19:34.589603 run osmo-hlr_10.42.42.2(pid=1393): stdout: | (launched: 2022-12-09_06:19:30.883932) 06:19:34.640924 run osmo-hlr_10.42.42.2(pid=1393): stderr: | 20221209061931193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061931193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061931193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061931193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061931193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061931193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061931211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061931228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061931228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061931228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:34.692638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1386): Terminating (SIGTERM) 06:19:34.734685 run iperf3-srv_10.42.42.10(pid=1387): Terminating (SIGTERM) 06:19:34.776278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1388): Terminating (SIGTERM) 06:19:34.818569 run iperf3-srv_10.42.42.10(pid=1389): Terminating (SIGTERM) 06:19:34.860295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1392): Terminating (SIGTERM) 06:19:34.902074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1395): Terminating (SIGTERM) 06:19:34.943997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1398): Terminating (SIGTERM) 06:19:34.986133 --- ParallelTerminationStrategy: PID 1386 died... 06:19:35.006081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1386): Terminated: ok {rc=0} 06:19:35.052703 --- ParallelTerminationStrategy: PID 1387 died... 06:19:35.072355 run iperf3-srv_10.42.42.10(pid=1387): Terminated {rc=256} 06:19:35.118441 --- ParallelTerminationStrategy: PID 1388 died... 06:19:35.138133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1388): Terminated: ok {rc=0} 06:19:35.184417 --- ParallelTerminationStrategy: PID 1389 died... 06:19:35.204153 run iperf3-srv_10.42.42.10(pid=1389): Terminated {rc=256} 06:19:35.250521 --- ParallelTerminationStrategy: PID 1392 died... 06:19:35.270238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1392): Terminated: ok {rc=0} 06:19:35.316750 --- ParallelTerminationStrategy: PID 1395 died... 06:19:35.336407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1395): Terminated: ok {rc=0} 06:19:35.382701 --- ParallelTerminationStrategy: PID 1398 died... 06:19:35.402339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1398): Terminated: ok {rc=0} 06:19:35.490084 bus /gobi_0: Setting Powered False 06:19:36.590453 bus /gobi_0: Setting Powered False 06:19:37.705637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:19:38.854386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:38.866198 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:38.937034 tst iperf3.py: using LAC 19521 06:19:39.062142 tst iperf3.py: using RAC 141 06:19:39.188890 tst iperf3.py: using CellId 19521 06:19:39.315533 tst iperf3.py: using BVCI 19522 06:19:39.431498 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.442671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.453659 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.464511 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.475899 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.487129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.498374 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.509541 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:39.520679 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:39.638863 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:39.852568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:40.170642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1400): Launched 06:19:40.445686 run iperf3-srv_10.42.42.10(pid=1401): Launched 06:19:40.565355 tst iperf3.py:8: start network... 06:19:40.778680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:41.269661 run create_hlr_db(pid=1402): Launched 06:19:41.398191 bus /gobi_6: Setting Powered False 06:19:42.460374 run create_hlr_db(pid=1402): Terminated: ok {rc=0} 06:19:42.885757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Launched 06:19:43.181316 run osmo-hlr_10.42.42.2(pid=1405): Launched 06:19:43.293933 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:43.804535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Launched 06:19:44.100291 run osmo-stp_10.42.42.5(pid=1408): Launched 06:19:44.212856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:44.723591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1410): Launched 06:19:44.836608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:45.086138 run patchelf(pid=1411): Launched 06:19:45.251230 run osmo-stp_10.42.42.5(pid=1408): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] 06:19:45.377312 run osmo-stp_10.42.42.5(pid=1408): stdout: | (launched: 2022-12-09_06:19:44.046064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:45.504328 run osmo-stp_10.42.42.5(pid=1408): stderr: | 20221209061944216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061944216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061944216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061944217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061944219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061944219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061944219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:45.632390 run osmo-stp_10.42.42.5(pid=1408): stdout: | (launched: 2022-12-09_06:19:44.046064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:45.754937 run osmo-stp_10.42.42.5(pid=1408): stderr: | 20221209061944216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061944216 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061944216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061944217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061944219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061944219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061944219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:45.939092 run patchelf(pid=1411): Terminating (SIGINT) 06:19:46.120104 run patchelf(pid=1411): Terminated: ok {rc=0} 06:19:46.254285 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1408): Process ended prematurely: osmo-stp_10.42.42.5(pid=1408) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 06:19:46.264740 tst iperf3.py:8: Test FAILED (7.4 sec) 06:19:46.295257 run osmo-hlr_10.42.42.2(pid=1405): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1405)] 06:19:46.348496 run osmo-hlr_10.42.42.2(pid=1405): stdout: | (launched: 2022-12-09_06:19:43.127190) 06:19:46.402396 run osmo-hlr_10.42.42.2(pid=1405): stderr: | 20221209061943301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061943301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061943301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061943301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061943301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061943301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061943328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061943338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061943338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061943338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:46.457508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1400): Terminating (SIGTERM) 06:19:46.501593 run iperf3-srv_10.42.42.10(pid=1401): Terminating (SIGTERM) 06:19:46.547076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Terminating (SIGTERM) 06:19:46.593127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Terminating (SIGTERM) 06:19:46.639251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1410): Terminating (SIGTERM) 06:19:46.686506 --- ParallelTerminationStrategy: PID 1400 died... 06:19:46.707356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1400): Terminated: ok {rc=0} 06:19:46.758585 --- ParallelTerminationStrategy: PID 1401 died... 06:19:46.778991 run iperf3-srv_10.42.42.10(pid=1401): Terminated {rc=256} 06:19:46.827714 --- ParallelTerminationStrategy: PID 1404 died... 06:19:46.848055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1404): Terminated: ok {rc=0} 06:19:46.896485 --- ParallelTerminationStrategy: PID 1407 died... 06:19:46.916900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1407): Terminated: ok {rc=0} 06:19:46.966851 --- ParallelTerminationStrategy: PID 1410 died... 06:19:46.987113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1410): Terminated: ok {rc=0} 06:19:47.082949 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:19:48.235800 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.247031 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:19:48.317388 tst iperf3m4.py: using LAC 19522 06:19:48.440394 tst iperf3m4.py: using RAC 142 06:19:48.557383 tst iperf3m4.py: using CellId 19522 06:19:48.675252 tst iperf3m4.py: using BVCI 19523 06:19:48.782924 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.793712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.804078 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.814804 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.825526 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.836142 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.846949 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.857635 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:19:48.868451 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:48.985961 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:49.104620 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:49.221861 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:19:49.338090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:19:49.537173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:49.835727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1412): Launched 06:19:50.094514 run iperf3-srv_10.42.42.10(pid=1413): Launched 06:19:50.205499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:19:50.402735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:50.699755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1414): Launched 06:19:50.957610 run iperf3-srv_10.42.42.10(pid=1415): Launched 06:19:51.068423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:19:51.265901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:51.563831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1416): Launched 06:19:51.822299 run iperf3-srv_10.42.42.10(pid=1417): Launched 06:19:51.933576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:19:52.131758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:19:52.429487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1418): Launched 06:19:52.687404 run iperf3-srv_10.42.42.10(pid=1419): Launched 06:19:52.798676 tst iperf3m4.py:8: start network... 06:19:52.995546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:19:53.453519 run create_hlr_db(pid=1420): Launched 06:19:53.566805 bus /gobi_6: Setting Powered False 06:19:54.626888 run create_hlr_db(pid=1420): Terminated: ok {rc=0} 06:19:55.040348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Launched 06:19:55.336301 run osmo-hlr_10.42.42.2(pid=1423): Launched 06:19:55.449426 run osmo-stp_10.42.42.5: Starting osmo-stp 06:19:55.962428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Launched 06:19:56.258312 run osmo-stp_10.42.42.5(pid=1426): Launched 06:19:56.371162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:19:56.880426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Launched 06:19:56.993245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:19:57.243305 run patchelf(pid=1429): Launched 06:19:57.408322 run osmo-stp_10.42.42.5(pid=1426): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] 06:19:57.534141 run osmo-stp_10.42.42.5(pid=1426): stdout: | (launched: 2022-12-09_06:19:56.203966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:57.661121 run osmo-stp_10.42.42.5(pid=1426): stderr: | 20221209061956369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061956369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061956369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061956370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061956370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061956370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061956370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:57.788209 run osmo-stp_10.42.42.5(pid=1426): stdout: | (launched: 2022-12-09_06:19:56.203966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:19:57.910454 run osmo-stp_10.42.42.5(pid=1426): stderr: | 20221209061956369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209061956369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209061956369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209061956370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209061956370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209061956370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209061956370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:19:58.055313 run patchelf(pid=1429): Terminating (SIGINT) 06:19:58.221976 run patchelf(pid=1429): Terminated: ok {rc=0} 06:19:58.341515 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1426): Process ended prematurely: osmo-stp_10.42.42.5(pid=1426) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:19:58.350656 tst iperf3m4.py:8: Test FAILED (10.2 sec) 06:19:58.378501 run osmo-hlr_10.42.42.2(pid=1423): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1423)] 06:19:58.426544 run osmo-hlr_10.42.42.2(pid=1423): stdout: | (launched: 2022-12-09_06:19:55.281828) 06:19:58.476125 run osmo-hlr_10.42.42.2(pid=1423): stderr: | 20221209061955456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209061955456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209061955456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209061955456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209061955456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209061955456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209061955468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209061955476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209061955477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209061955477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:19:58.526101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1412): Terminating (SIGTERM) 06:19:58.566362 run iperf3-srv_10.42.42.10(pid=1413): Terminating (SIGTERM) 06:19:58.606527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1414): Terminating (SIGTERM) 06:19:58.646969 run iperf3-srv_10.42.42.10(pid=1415): Terminating (SIGTERM) 06:19:58.687004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1416): Terminating (SIGTERM) 06:19:58.727156 run iperf3-srv_10.42.42.10(pid=1417): Terminating (SIGTERM) 06:19:58.767049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1418): Terminating (SIGTERM) 06:19:58.807029 run iperf3-srv_10.42.42.10(pid=1419): Terminating (SIGTERM) 06:19:58.846987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Terminating (SIGTERM) 06:19:58.886928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Terminating (SIGTERM) 06:19:58.926946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Terminating (SIGTERM) 06:19:58.967185 --- ParallelTerminationStrategy: PID 1412 died... 06:19:58.986316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1412): Terminated: ok {rc=0} 06:19:59.031032 --- ParallelTerminationStrategy: PID 1413 died... 06:19:59.049712 run iperf3-srv_10.42.42.10(pid=1413): Terminated {rc=256} 06:19:59.094038 --- ParallelTerminationStrategy: PID 1414 died... 06:19:59.112583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1414): Terminated: ok {rc=0} 06:19:59.156878 --- ParallelTerminationStrategy: PID 1415 died... 06:19:59.175918 run iperf3-srv_10.42.42.10(pid=1415): Terminated {rc=256} 06:19:59.220252 --- ParallelTerminationStrategy: PID 1416 died... 06:19:59.238921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1416): Terminated: ok {rc=0} 06:19:59.283213 --- ParallelTerminationStrategy: PID 1417 died... 06:19:59.301864 run iperf3-srv_10.42.42.10(pid=1417): Terminated {rc=256} 06:19:59.346214 --- ParallelTerminationStrategy: PID 1418 died... 06:19:59.364809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1418): Terminated: ok {rc=0} 06:19:59.409340 --- ParallelTerminationStrategy: PID 1419 died... 06:19:59.427928 run iperf3-srv_10.42.42.10(pid=1419): Terminated {rc=256} 06:19:59.472252 --- ParallelTerminationStrategy: PID 1422 died... 06:19:59.490923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Terminated: ok {rc=0} 06:19:59.535255 --- ParallelTerminationStrategy: PID 1425 died... 06:19:59.553933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Terminated: ok {rc=0} 06:19:59.598298 --- ParallelTerminationStrategy: PID 1428 died... 06:19:59.616936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Terminated: ok {rc=0} 06:19:59.701127 bus /gobi_4: Setting Powered False 06:20:00.796121 bus /gobi_4: Setting Powered False 06:20:01.933264 bus /gobi_1: Setting Powered False 06:20:03.029530 bus /gobi_1: Setting Powered False 06:20:04.144706 bus /gobi_0: Setting Powered False 06:20:05.244370 bus /gobi_0: Setting Powered False 06:20:06.360844 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:20:07.463872 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:07.475096 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:20:07.544851 tst ping.py: using LAC 19523 06:20:07.661609 tst ping.py: using RAC 143 06:20:07.775707 tst ping.py: using CellId 19523 06:20:07.889569 tst ping.py: using BVCI 19524 06:20:07.994785 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.005615 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.016043 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.026973 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.037807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.048455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.059385 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:08.070097 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:08.182012 tst ping.py:19: start network... 06:20:08.377192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:08.829511 run create_hlr_db(pid=1433): Launched 06:20:08.941530 bus /gobi_6: Setting Powered False 06:20:10.000527 run create_hlr_db(pid=1433): Terminated: ok {rc=0} 06:20:10.429502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1435): Launched 06:20:10.742925 run osmo-hlr_10.42.42.2(pid=1436): Launched 06:20:10.862167 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:11.402089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1438): Launched 06:20:11.714284 run osmo-stp_10.42.42.5(pid=1439): Launched 06:20:11.832850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:12.372241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1441): Launched 06:20:12.492506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:12.758247 run patchelf(pid=1442): Launched 06:20:12.933202 run osmo-stp_10.42.42.5(pid=1439): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1439)] 06:20:13.066790 run osmo-stp_10.42.42.5(pid=1439): stdout: | (launched: 2022-12-09_06:20:11.657762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:13.201320 run osmo-stp_10.42.42.5(pid=1439): stderr: | 20221209062011847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062011847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062011847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062011848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062011848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062011848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062011848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:13.336144 run osmo-stp_10.42.42.5(pid=1439): stdout: | (launched: 2022-12-09_06:20:11.657762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:13.464585 run osmo-stp_10.42.42.5(pid=1439): stderr: | 20221209062011847 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062011847 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062011847 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062011848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062011848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062011848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062011848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:13.617292 run patchelf(pid=1442): Terminating (SIGINT) 06:20:13.793158 run patchelf(pid=1442): Terminated: ok {rc=0} 06:20:13.919961 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1439): Process ended prematurely: osmo-stp_10.42.42.5(pid=1439) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1439)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 06:20:13.929357 tst ping.py:22: Test FAILED (6.5 sec) 06:20:13.957590 run osmo-hlr_10.42.42.2(pid=1436): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1436)] 06:20:14.008156 run osmo-hlr_10.42.42.2(pid=1436): stdout: | (launched: 2022-12-09_06:20:10.686336) 06:20:14.060417 run osmo-hlr_10.42.42.2(pid=1436): stderr: | 20221209062010881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062010881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062010882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062010882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062010882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062010882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062010894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062010903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062010903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062010903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:14.113387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1435): Terminating (SIGTERM) 06:20:14.156267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1438): Terminating (SIGTERM) 06:20:14.198949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1441): Terminating (SIGTERM) 06:20:14.241850 --- ParallelTerminationStrategy: PID 1435 died... 06:20:14.261974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1435): Terminated: ok {rc=0} 06:20:14.309510 --- ParallelTerminationStrategy: PID 1438 died... 06:20:14.329298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1438): Terminated: ok {rc=0} 06:20:14.376318 --- ParallelTerminationStrategy: PID 1441 died... 06:20:14.396243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1441): Terminated: ok {rc=0} 06:20:14.484653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:20:15.571787 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:15.583648 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:20:15.657037 tst ping_idle_ping.py: using LAC 19524 06:20:15.781095 tst ping_idle_ping.py: using RAC 144 06:20:15.926716 tst ping_idle_ping.py: using CellId 19524 06:20:16.060545 tst ping_idle_ping.py: using BVCI 19525 06:20:16.176920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.189240 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.201276 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.213885 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.226261 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.238893 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.251339 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:20:16.264921 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:20:16.385613 tst ping_idle_ping.py:24: start network... 06:20:16.592506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:17.072397 run create_hlr_db(pid=1443): Launched 06:20:17.231880 bus /gobi_6: Setting Powered False 06:20:18.295292 run create_hlr_db(pid=1443): Terminated: ok {rc=0} 06:20:18.715692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Launched 06:20:19.008445 run osmo-hlr_10.42.42.2(pid=1446): Launched 06:20:19.120237 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:19.635891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Launched 06:20:19.926614 run osmo-stp_10.42.42.5(pid=1449): Launched 06:20:20.037848 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:20.542405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1451): Launched 06:20:20.654741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:20.901073 run patchelf(pid=1452): Launched 06:20:21.063522 run osmo-stp_10.42.42.5(pid=1449): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] 06:20:21.189075 run osmo-stp_10.42.42.5(pid=1449): stdout: | (launched: 2022-12-09_06:20:19.873399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:21.314790 run osmo-stp_10.42.42.5(pid=1449): stderr: | 20221209062020042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062020043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062020043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062020043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062020044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062020044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062020044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:21.440462 run osmo-stp_10.42.42.5(pid=1449): stdout: | (launched: 2022-12-09_06:20:19.873399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:21.560137 run osmo-stp_10.42.42.5(pid=1449): stderr: | 20221209062020042 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062020043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062020043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062020043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062020044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062020044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062020044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:21.702379 run patchelf(pid=1452): Terminating (SIGINT) 06:20:21.866513 run patchelf(pid=1452): Terminated: ok {rc=0} 06:20:21.984673 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1449): Process ended prematurely: osmo-stp_10.42.42.5(pid=1449) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:20:21.993495 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:20:22.020835 run osmo-hlr_10.42.42.2(pid=1446): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1446)] 06:20:22.069194 run osmo-hlr_10.42.42.2(pid=1446): stdout: | (launched: 2022-12-09_06:20:18.954926) 06:20:22.119411 run osmo-hlr_10.42.42.2(pid=1446): stderr: | 20221209062019127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062019127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062019127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062019127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062019127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062019127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062019139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062019150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062019150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062019150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:22.170033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Terminating (SIGTERM) 06:20:22.210905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Terminating (SIGTERM) 06:20:22.251428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1451): Terminating (SIGTERM) 06:20:22.292214 --- ParallelTerminationStrategy: PID 1445 died... 06:20:22.311632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1445): Terminated: ok {rc=0} 06:20:22.356739 --- ParallelTerminationStrategy: PID 1448 died... 06:20:22.375669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1448): Terminated: ok {rc=0} 06:20:22.421062 --- ParallelTerminationStrategy: PID 1451 died... 06:20:22.439746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1451): Terminated: ok {rc=0} 06:20:22.526857 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:20:23.829948 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:23.836681 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:20:23.870036 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:20:23.904217 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:20:23.956821 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:20:23.991534 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:20:24.027079 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:20:24.582848 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:20:24.590017 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:24.602098 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:20:24.673963 tst switch_tch_pdch.py: using LAC 19525 06:20:24.789351 tst switch_tch_pdch.py: using RAC 145 06:20:24.902626 tst switch_tch_pdch.py: using CellId 19525 06:20:25.014899 tst switch_tch_pdch.py: using BVCI 19526 06:20:25.120487 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.131582 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.142423 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.153489 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.164623 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.175632 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.186761 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:20:25.197945 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:20:25.314187 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:20:25.439455 tst switch_tch_pdch.py:51: start network... 06:20:25.635071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:26.088060 run create_hlr_db(pid=1457): Launched 06:20:26.198627 bus /gobi_6: Setting Powered False 06:20:27.257527 run create_hlr_db(pid=1457): Terminated: ok {rc=0} 06:20:27.688603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Launched 06:20:28.001613 run osmo-hlr_10.42.42.2(pid=1460): Launched 06:20:28.121016 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:28.663725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Launched 06:20:28.975175 run osmo-stp_10.42.42.5(pid=1463): Launched 06:20:29.093970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:29.633547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Launched 06:20:29.753084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:30.016315 run patchelf(pid=1466): Launched 06:20:30.190996 run osmo-stp_10.42.42.5(pid=1463): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] 06:20:30.324154 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-09_06:20:28.918701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:30.458488 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221209062029108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062029108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062029108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062029108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062029109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062029109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062029109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:30.593055 run osmo-stp_10.42.42.5(pid=1463): stdout: | (launched: 2022-12-09_06:20:28.918701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:30.721570 run osmo-stp_10.42.42.5(pid=1463): stderr: | 20221209062029108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062029108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062029108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062029108 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062029109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062029109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062029109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:30.901300 run patchelf(pid=1466): Terminating (SIGINT) 06:20:31.081335 run patchelf(pid=1466): Terminated: ok {rc=0} 06:20:31.210415 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:20:31.220353 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 06:20:31.249330 run osmo-hlr_10.42.42.2(pid=1460): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1460)] 06:20:31.301281 run osmo-hlr_10.42.42.2(pid=1460): stdout: | (launched: 2022-12-09_06:20:27.944777) 06:20:31.354676 run osmo-hlr_10.42.42.2(pid=1460): stderr: | 20221209062028139 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062028139 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062028139 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062028139 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062028139 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062028139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062028153 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062028161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062028162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062028162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:31.408288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminating (SIGTERM) 06:20:31.451398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminating (SIGTERM) 06:20:31.494591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Terminating (SIGTERM) 06:20:31.538637 --- ParallelTerminationStrategy: PID 1459 died... 06:20:31.559494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1459): Terminated: ok {rc=0} 06:20:31.608267 --- ParallelTerminationStrategy: PID 1462 died... 06:20:31.628261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1462): Terminated: ok {rc=0} 06:20:31.675586 --- ParallelTerminationStrategy: PID 1465 died... 06:20:31.695764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1465): Terminated: ok {rc=0} 06:20:31.789223 bus /gobi_0: Setting Powered False 06:20:32.889037 bus /gobi_0: Setting Powered False 06:20:34.004766 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:20:35.259279 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:35.265429 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:20:35.298883 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:20:35.333764 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:20:35.386748 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:20:35.419815 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:20:35.454360 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:20:36.010595 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:20:36.015734 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.026896 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:20:36.099956 tst switch_tch_pdch.py: using LAC 19526 06:20:36.222521 tst switch_tch_pdch.py: using RAC 146 06:20:36.343637 tst switch_tch_pdch.py: using CellId 19526 06:20:36.466008 tst switch_tch_pdch.py: using BVCI 19527 06:20:36.579420 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.590695 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.601788 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.613026 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.623973 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.635010 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.646131 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:20:36.657228 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:20:36.770733 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:20:36.887582 tst switch_tch_pdch.py:51: start network... 06:20:37.096931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:37.553102 run create_hlr_db(pid=1470): Launched 06:20:37.679537 bus /gobi_6: Setting Powered False 06:20:38.741189 run create_hlr_db(pid=1470): Terminated: ok {rc=0} 06:20:39.132730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1472): Launched 06:20:39.422901 run osmo-hlr_10.42.42.2(pid=1473): Launched 06:20:39.533251 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:40.007335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1475): Launched 06:20:40.296425 run osmo-stp_10.42.42.5(pid=1476): Launched 06:20:40.407187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:20:40.882204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1478): Launched 06:20:40.993597 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:20:41.238482 run patchelf(pid=1479): Launched 06:20:41.400101 run osmo-stp_10.42.42.5(pid=1476): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1476)] 06:20:41.524083 run osmo-stp_10.42.42.5(pid=1476): stdout: | (launched: 2022-12-09_06:20:40.243529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:41.649932 run osmo-stp_10.42.42.5(pid=1476): stderr: | 20221209062040411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062040411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062040411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062040412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062040412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062040412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062040412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:41.775472 run osmo-stp_10.42.42.5(pid=1476): stdout: | (launched: 2022-12-09_06:20:40.243529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:20:41.895200 run osmo-stp_10.42.42.5(pid=1476): stderr: | 20221209062040411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062040411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062040411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062040412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062040412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062040412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062040412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:20:42.036712 run patchelf(pid=1479): Terminating (SIGINT) 06:20:42.201317 run patchelf(pid=1479): Terminated: ok {rc=0} 06:20:42.319832 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1476): Process ended prematurely: osmo-stp_10.42.42.5(pid=1476) [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1476)] [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:20:42.328393 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 06:20:42.355546 run osmo-hlr_10.42.42.2(pid=1473): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1473)] 06:20:42.404030 run osmo-hlr_10.42.42.2(pid=1473): stdout: | (launched: 2022-12-09_06:20:39.370323) 06:20:42.453786 run osmo-hlr_10.42.42.2(pid=1473): stderr: | 20221209062039541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062039541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062039541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062039542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062039542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062039542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062039555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062039564 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062039564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062039564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:20:42.503969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1472): Terminating (SIGTERM) 06:20:42.544361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1475): Terminating (SIGTERM) 06:20:42.584801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1478): Terminating (SIGTERM) 06:20:42.625461 --- ParallelTerminationStrategy: PID 1472 died... 06:20:42.644754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1472): Terminated: ok {rc=0} 06:20:42.689823 --- ParallelTerminationStrategy: PID 1475 died... 06:20:42.708444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1475): Terminated: ok {rc=0} 06:20:42.753317 --- ParallelTerminationStrategy: PID 1478 died... 06:20:42.772028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1478): Terminated: ok {rc=0} 06:20:42.858019 bus /gobi_0: Setting Powered False 06:20:43.955594 bus /gobi_0: Setting Powered False 06:20:45.068138 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:46.339211 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:46.345224 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:46.382149 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:20:46.389813 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:20:46.443631 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:46.474610 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:20:46.482187 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:20:47.035754 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:20:47.042563 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:20:47.058225 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:47.113879 tst mo_mt_sms.py: using LAC 19527 06:20:47.249278 tst mo_mt_sms.py: using RAC 147 06:20:47.368173 tst mo_mt_sms.py: using CellId 19527 06:20:47.480271 tst mo_mt_sms.py: using BVCI 19528 06:20:47.585232 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:47.702116 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:47.819440 tst mo_mt_sms.py:9: start nitb and bts... 06:20:48.032084 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:20:48.671320 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1484): Launched 06:20:48.982733 run osmo-nitb_10.42.42.2(pid=1485): Launched 06:20:49.154957 run osmo-nitb_10.42.42.2(pid=1485): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1485)] 06:20:49.296162 run osmo-nitb_10.42.42.2(pid=1485): stdout: | (launched: 2022-12-09_06:20:48.926378) 06:20:49.439334 run osmo-nitb_10.42.42.2(pid=1485): stderr: | (launched: 2022-12-09_06:20:48.972840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:49.582434 run osmo-nitb_10.42.42.2(pid=1485): stdout: | (launched: 2022-12-09_06:20:48.926378) 06:20:49.718646 run osmo-nitb_10.42.42.2(pid=1485): stderr: | (launched: 2022-12-09_06:20:48.972840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1485) [trial-2355↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1485)] 06:20:50.099274 tst osmo-nitb_10.42.42.2(pid=1485): stdout: | (launched: 2022-12-09_06:20:48.926378) 06:20:50.225517 tst osmo-nitb_10.42.42.2(pid=1485): stderr: | (launched: 2022-12-09_06:20:48.972840) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:20:50.374484 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1485) [trial-2355↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1485)] [trial-2355↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 06:20:50.383348 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 06:20:50.390286 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1484): Terminating (SIGTERM) 06:20:50.600873 --- ParallelTerminationStrategy: PID 1484 died... 06:20:50.622359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1484): Terminated: ok {rc=0} 06:20:50.709545 bus /sierra_3: Setting Powered False 06:20:51.807722 bus /sierra_3: Setting Powered False 06:20:52.923601 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 06:20:54.119999 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:20:54.124031 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:20:54.153729 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:20:54.179990 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:20:54.230639 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:20:54.261291 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:20:54.289173 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:20:54.835774 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 06:20:54.841119 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:54.852154 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:20:54.901944 tst mo_mt_sms.py: using LAC 19528 06:20:55.023997 tst mo_mt_sms.py: using RAC 148 06:20:55.144686 tst mo_mt_sms.py: using CellId 19528 06:20:55.258157 tst mo_mt_sms.py: using BVCI 19529 06:20:55.365351 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:55.375996 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:55.386713 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:55.397458 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:55.408093 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:20:55.418962 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:55.534696 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:20:55.652598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:20:56.135555 run create_hlr_db(pid=1489): Launched 06:20:56.262643 bus /sierra_2: Setting Powered False 06:20:57.325075 run create_hlr_db(pid=1489): Terminated: ok {rc=0} 06:20:57.742271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1491): Launched 06:20:58.032235 run osmo-hlr_10.42.42.2(pid=1492): Launched 06:20:58.143196 run osmo-stp_10.42.42.5: Starting osmo-stp 06:20:58.644502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1494): Launched 06:20:58.934446 run osmo-stp_10.42.42.5(pid=1495): Launched 06:20:59.044249 run osmo-msc_10.42.42.6: Starting osmo-msc 06:20:59.576230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1497): Launched 06:20:59.866647 run osmo-msc_10.42.42.6(pid=1498): Launched 06:21:00.028399 run osmo-stp_10.42.42.5(pid=1495): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1495)] 06:21:00.152585 run osmo-stp_10.42.42.5(pid=1495): stdout: | (launched: 2022-12-09_06:20:58.881373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:00.277437 run osmo-stp_10.42.42.5(pid=1495): stderr: | 20221209062059050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062059051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062059051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062059051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062059052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062059052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062059052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:00.399484 run osmo-stp_10.42.42.5(pid=1495): stdout: | (launched: 2022-12-09_06:20:58.881373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:00.515715 run osmo-stp_10.42.42.5(pid=1495): stderr: | 20221209062059050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062059051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062059051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062059051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062059052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062059052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062059052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:00.654868 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1495): Process ended prematurely: osmo-stp_10.42.42.5(pid=1495) [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1495)] [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 06:21:00.663186 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 06:21:00.690016 run osmo-hlr_10.42.42.2(pid=1492): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1492)] 06:21:00.738320 run osmo-hlr_10.42.42.2(pid=1492): stdout: | (launched: 2022-12-09_06:20:57.979225) 06:21:00.788427 run osmo-hlr_10.42.42.2(pid=1492): stderr: | 20221209062058153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062058153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062058153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062058153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062058153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062058153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062058166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062058176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062058176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062058177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:00.878280 run osmo-msc_10.42.42.6(pid=1498): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1498)] 06:21:00.951025 run osmo-msc_10.42.42.6(pid=1498): stdout: | (launched: 2022-12-09_06:20:59.813650) 06:21:01.004172 run osmo-msc_10.42.42.6(pid=1498): stderr: | 20221209062100081 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062100081 DLGLOBAL DEBUG validating counter group 0x7f8deb9abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062100081 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062100081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062100081 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062100082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062100083 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062100084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062100084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062100084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:01.056892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1491): Terminating (SIGTERM) 06:21:01.100301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1494): Terminating (SIGTERM) 06:21:01.144314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1497): Terminating (SIGTERM) 06:21:01.187225 --- ParallelTerminationStrategy: PID 1491 died... 06:21:01.207025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1491): Terminated: ok {rc=0} 06:21:01.254763 --- ParallelTerminationStrategy: PID 1494 died... 06:21:01.274631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1494): Terminated: ok {rc=0} 06:21:01.322458 --- ParallelTerminationStrategy: PID 1497 died... 06:21:01.342227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1497): Terminated: ok {rc=0} 06:21:01.433870 bus /sierra_3: Setting Powered False 06:21:02.540069 bus /sierra_3: Setting Powered False 06:21:03.656125 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:21:04.886550 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:04.890625 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:21:04.919804 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 06:21:04.926709 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:21:04.961275 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:21:04.990352 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 06:21:04.997135 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:21:05.518187 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:21:05.524094 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 06:21:05.535408 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:21:05.579892 tst assert_extension.py: using LAC 19529 06:21:05.704092 tst assert_extension.py: using RAC 149 06:21:05.826460 tst assert_extension.py: using CellId 19529 06:21:05.948140 tst assert_extension.py: using BVCI 19530 06:21:06.061316 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:21:06.174728 tst assert_extension.py:10: start nitb and bts... 06:21:06.368920 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:21:06.966879 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1503): Launched 06:21:07.258481 run osmo-nitb_10.42.42.2(pid=1504): Launched 06:21:07.419601 run osmo-nitb_10.42.42.2(pid=1504): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1504)] 06:21:07.551081 run osmo-nitb_10.42.42.2(pid=1504): stdout: | (launched: 2022-12-09_06:21:07.205239) 06:21:07.684510 run osmo-nitb_10.42.42.2(pid=1504): stderr: | (launched: 2022-12-09_06:21:07.248586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:21:07.817858 run osmo-nitb_10.42.42.2(pid=1504): stdout: | (launched: 2022-12-09_06:21:07.205239) 06:21:07.945151 run osmo-nitb_10.42.42.2(pid=1504): stderr: | (launched: 2022-12-09_06:21:07.248586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1504) [trial-2355↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1504)] 06:21:08.367695 tst osmo-nitb_10.42.42.2(pid=1504): stdout: | (launched: 2022-12-09_06:21:07.205239) 06:21:08.484514 tst osmo-nitb_10.42.42.2(pid=1504): stderr: | (launched: 2022-12-09_06:21:07.248586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:21:08.622950 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1504) [trial-2355↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1504)] [trial-2355↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 06:21:08.631226 tst assert_extension.py:12: Test FAILED (3.1 sec) 06:21:08.637683 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1503): Terminating (SIGTERM) 06:21:08.846879 --- ParallelTerminationStrategy: PID 1503 died... 06:21:08.867568 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1503): Terminated: ok {rc=0} 06:21:08.954218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 06:21:10.122940 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:10.126780 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:21:10.156938 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:21:10.183890 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 06:21:10.219804 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:21:10.250111 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:21:10.277113 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 06:21:10.803931 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 06:21:10.810112 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:10.821285 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:21:10.866616 tst assert_extension.py: using LAC 19530 06:21:10.990863 tst assert_extension.py: using RAC 150 06:21:11.113713 tst assert_extension.py: using CellId 19530 06:21:11.237878 tst assert_extension.py: using BVCI 19531 06:21:11.350715 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:11.361910 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:11.372847 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:11.383777 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:11.394719 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:21:11.406292 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 06:21:11.524823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:12.009501 run create_hlr_db(pid=1508): Launched 06:21:12.136259 bus /sierra_2: Setting Powered False 06:21:13.198654 run create_hlr_db(pid=1508): Terminated: ok {rc=0} 06:21:13.636224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Launched 06:21:13.948164 run osmo-hlr_10.42.42.2(pid=1511): Launched 06:21:14.066930 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:14.612236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Launched 06:21:14.925424 run osmo-stp_10.42.42.5(pid=1514): Launched 06:21:15.045323 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:15.611633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1516): Launched 06:21:15.941669 run osmo-msc_10.42.42.6(pid=1517): Launched 06:21:16.148392 run osmo-stp_10.42.42.5(pid=1514): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] 06:21:16.515213 run osmo-stp_10.42.42.5(pid=1514): stdout: | (launched: 2022-12-09_06:21:14.868707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:16.703575 run osmo-stp_10.42.42.5(pid=1514): stderr: | 20221209062115060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062115060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062115060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062115061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062115061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062115061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062115061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:16.838236 run osmo-stp_10.42.42.5(pid=1514): stdout: | (launched: 2022-12-09_06:21:14.868707) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:16.966668 run osmo-stp_10.42.42.5(pid=1514): stderr: | 20221209062115060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062115060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062115060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062115061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062115061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062115061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062115061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:17.120107 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1514): Process ended prematurely: osmo-stp_10.42.42.5(pid=1514) [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 06:21:17.129917 tst assert_extension.py:17: Test FAILED (6.3 sec) 06:21:17.160542 run osmo-hlr_10.42.42.2(pid=1511): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1511)] 06:21:17.213292 run osmo-hlr_10.42.42.2(pid=1511): stdout: | (launched: 2022-12-09_06:21:13.891391) 06:21:17.267607 run osmo-hlr_10.42.42.2(pid=1511): stderr: | 20221209062114090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062114091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062114091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062114091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062114091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062114091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062114103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062114111 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062114112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062114112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:17.342794 run osmo-msc_10.42.42.6(pid=1517): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1517)] 06:21:17.394184 run osmo-msc_10.42.42.6(pid=1517): stdout: | (launched: 2022-12-09_06:21:15.873392) 06:21:17.447120 run osmo-msc_10.42.42.6(pid=1517): stderr: | 20221209062116392 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062116393 DLGLOBAL DEBUG validating counter group 0x7fcf05d46c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062116393 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062116393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062116393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062116395 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062116398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062116398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062116398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062116398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:17.500409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Terminating (SIGTERM) 06:21:17.543477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Terminating (SIGTERM) 06:21:17.586836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1516): Terminating (SIGTERM) 06:21:17.630431 --- ParallelTerminationStrategy: PID 1510 died... 06:21:17.650789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Terminated: ok {rc=0} 06:21:17.698936 --- ParallelTerminationStrategy: PID 1513 died... 06:21:17.718993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Terminated: ok {rc=0} 06:21:17.766937 --- ParallelTerminationStrategy: PID 1516 died... 06:21:17.786852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1516): Terminated: ok {rc=0} 06:21:17.877080 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:21:19.086641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:19.093322 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:21:19.122385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:21:19.148208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:21:19.199446 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:21:19.228044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:21:19.253975 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:21:19.805897 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:21:19.854980 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:19.866070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:21:19.929619 tst mo_mt_call.py: using LAC 19531 06:21:20.057902 tst mo_mt_call.py: using RAC 151 06:21:20.185203 tst mo_mt_call.py: using CellId 19531 06:21:20.310090 tst mo_mt_call.py: using BVCI 19532 06:21:20.425944 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:20.437761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:20.449500 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:20.461212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:20.472933 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:20.484731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:21:20.599229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:21:20.717564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:21.211102 run create_hlr_db(pid=1522): Launched 06:21:21.339996 bus /sierra_2: Setting Powered False 06:21:22.403421 run create_hlr_db(pid=1522): Terminated: ok {rc=0} 06:21:22.829979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1524): Launched 06:21:23.128104 run osmo-hlr_10.42.42.2(pid=1525): Launched 06:21:23.241252 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:23.764880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1527): Launched 06:21:24.062100 run osmo-stp_10.42.42.5(pid=1528): Launched 06:21:24.174768 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:24.711250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1530): Launched 06:21:25.007656 run osmo-msc_10.42.42.6(pid=1531): Launched 06:21:25.174147 run osmo-stp_10.42.42.5(pid=1528): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1528)] 06:21:25.301597 run osmo-stp_10.42.42.5(pid=1528): stdout: | (launched: 2022-12-09_06:21:24.007833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:25.428760 run osmo-stp_10.42.42.5(pid=1528): stderr: | 20221209062124178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062124179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062124179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062124179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062124180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062124180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062124180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:25.552807 run osmo-stp_10.42.42.5(pid=1528): stdout: | (launched: 2022-12-09_06:21:24.007833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:25.671111 run osmo-stp_10.42.42.5(pid=1528): stderr: | 20221209062124178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062124179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062124179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062124179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062124180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062124180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062124180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:25.812540 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1528): Process ended prematurely: osmo-stp_10.42.42.5(pid=1528) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1528)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:21:25.821354 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:21:25.848084 run osmo-hlr_10.42.42.2(pid=1525): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1525)] 06:21:25.895703 run osmo-hlr_10.42.42.2(pid=1525): stdout: | (launched: 2022-12-09_06:21:23.072804) 06:21:25.945194 run osmo-hlr_10.42.42.2(pid=1525): stderr: | 20221209062123251 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062123251 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062123251 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062123251 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062123251 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062123251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062123262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062123270 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062123270 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062123270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:26.014588 run osmo-msc_10.42.42.6(pid=1531): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1531)] 06:21:26.062312 run osmo-msc_10.42.42.6(pid=1531): stdout: | (launched: 2022-12-09_06:21:24.953480) 06:21:26.111563 run osmo-msc_10.42.42.6(pid=1531): stderr: | 20221209062125225 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062125225 DLGLOBAL DEBUG validating counter group 0x7fcbe7e48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062125225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062125225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062125225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062125225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062125227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062125228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062125228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062125228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:26.161221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1524): Terminating (SIGTERM) 06:21:26.201094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1527): Terminating (SIGTERM) 06:21:26.240810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1530): Terminating (SIGTERM) 06:21:26.281048 --- ParallelTerminationStrategy: PID 1524 died... 06:21:26.299997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1524): Terminated: ok {rc=0} 06:21:26.344053 --- ParallelTerminationStrategy: PID 1527 died... 06:21:26.362529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1527): Terminated: ok {rc=0} 06:21:26.406459 --- ParallelTerminationStrategy: PID 1530 died... 06:21:26.425193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1530): Terminated: ok {rc=0} 06:21:26.511198 bus /sierra_3: Setting Powered False 06:21:27.609305 bus /sierra_3: Setting Powered False 06:21:28.724279 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:21:29.868424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:29.880287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:21:29.945253 tst mo_mt_call_osmux.py: using LAC 19532 06:21:30.064050 tst mo_mt_call_osmux.py: using RAC 152 06:21:30.185059 tst mo_mt_call_osmux.py: using CellId 19532 06:21:30.301960 tst mo_mt_call_osmux.py: using BVCI 19533 06:21:30.411828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:30.422986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:30.434044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:30.445278 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:30.456439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:21:30.467561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:21:30.585181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:21:30.703820 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:31.227324 run create_hlr_db(pid=1533): Launched 06:21:31.380351 bus /sierra_2: Setting Powered False 06:21:32.440289 run create_hlr_db(pid=1533): Terminated: ok {rc=0} 06:21:32.857411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Launched 06:21:33.155106 run osmo-hlr_10.42.42.2(pid=1536): Launched 06:21:33.268012 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:33.793647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Launched 06:21:34.090014 run osmo-stp_10.42.42.5(pid=1539): Launched 06:21:34.202568 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:34.743086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Launched 06:21:35.039437 run osmo-msc_10.42.42.6(pid=1542): Launched 06:21:35.205370 run osmo-stp_10.42.42.5(pid=1539): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1539)] 06:21:35.332488 run osmo-stp_10.42.42.5(pid=1539): stdout: | (launched: 2022-12-09_06:21:34.035563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:35.458736 run osmo-stp_10.42.42.5(pid=1539): stderr: | 20221209062134203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062134204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062134204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062134204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062134206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062134207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062134207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:35.583064 run osmo-stp_10.42.42.5(pid=1539): stdout: | (launched: 2022-12-09_06:21:34.035563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:35.701175 run osmo-stp_10.42.42.5(pid=1539): stderr: | 20221209062134203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062134204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062134204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062134204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062134206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062134207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062134207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:35.842416 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1539): Process ended prematurely: osmo-stp_10.42.42.5(pid=1539) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1539)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:21:35.851262 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:21:35.878170 run osmo-hlr_10.42.42.2(pid=1536): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1536)] 06:21:35.926359 run osmo-hlr_10.42.42.2(pid=1536): stdout: | (launched: 2022-12-09_06:21:33.100175) 06:21:35.976061 run osmo-hlr_10.42.42.2(pid=1536): stderr: | 20221209062133275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062133275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062133275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062133275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062133275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062133275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062133287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062133296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062133296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062133296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:36.045409 run osmo-msc_10.42.42.6(pid=1542): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1542)] 06:21:36.093284 run osmo-msc_10.42.42.6(pid=1542): stdout: | (launched: 2022-12-09_06:21:34.985263) 06:21:36.143014 run osmo-msc_10.42.42.6(pid=1542): stderr: | 20221209062135255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062135255 DLGLOBAL DEBUG validating counter group 0x7f83ada36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062135255 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062135255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062135255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062135255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062135258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062135258 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062135258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062135258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:36.193282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Terminating (SIGTERM) 06:21:36.233225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Terminating (SIGTERM) 06:21:36.273262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Terminating (SIGTERM) 06:21:36.314194 --- ParallelTerminationStrategy: PID 1535 died... 06:21:36.333332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Terminated: ok {rc=0} 06:21:36.377842 --- ParallelTerminationStrategy: PID 1538 died... 06:21:36.396535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Terminated: ok {rc=0} 06:21:36.441261 --- ParallelTerminationStrategy: PID 1541 died... 06:21:36.459717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Terminated: ok {rc=0} 06:21:36.546294 bus /sierra_3: Setting Powered False 06:21:37.646348 bus /sierra_3: Setting Powered False 06:21:38.761094 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:21:40.008430 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:21:40.015379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:21:40.045195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:21:40.072062 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:21:40.125741 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:21:40.155808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:21:40.182976 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:21:40.733841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:21:40.784821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:40.796355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:21:40.866453 tst mo_mt_call.py: using LAC 19533 06:21:40.990387 tst mo_mt_call.py: using RAC 153 06:21:41.114197 tst mo_mt_call.py: using CellId 19533 06:21:41.237686 tst mo_mt_call.py: using BVCI 19534 06:21:41.353655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:41.365235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:41.376628 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:41.388026 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:41.399485 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:41.411002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:41.525385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:41.639423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:42.101034 run create_hlr_db(pid=1547): Launched 06:21:42.214868 bus /sierra_2: Setting Powered False 06:21:43.273886 run create_hlr_db(pid=1547): Terminated: ok {rc=0} 06:21:43.688284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1549): Launched 06:21:43.985043 run osmo-hlr_10.42.42.2(pid=1550): Launched 06:21:44.098857 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:44.622558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1552): Launched 06:21:44.919380 run osmo-stp_10.42.42.5(pid=1553): Launched 06:21:45.033747 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:45.573218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1555): Launched 06:21:45.892222 run osmo-msc_10.42.42.6(pid=1556): Launched 06:21:46.203121 run osmo-stp_10.42.42.5(pid=1553): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1553)] 06:21:46.511975 run osmo-stp_10.42.42.5(pid=1553): stdout: | (launched: 2022-12-09_06:21:44.865265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:46.654065 run osmo-stp_10.42.42.5(pid=1553): stderr: | 20221209062145033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062145033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062145033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062145034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062145034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062145034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062145034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:46.794534 run osmo-stp_10.42.42.5(pid=1553): stdout: | (launched: 2022-12-09_06:21:44.865265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:46.930523 run osmo-stp_10.42.42.5(pid=1553): stderr: | 20221209062145033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062145033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062145033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062145034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062145034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062145034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062145034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:47.102135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1553): Process ended prematurely: osmo-stp_10.42.42.5(pid=1553) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1553)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:21:47.112434 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:21:47.141779 run osmo-hlr_10.42.42.2(pid=1550): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1550)] 06:21:47.194729 run osmo-hlr_10.42.42.2(pid=1550): stdout: | (launched: 2022-12-09_06:21:43.930517) 06:21:47.247690 run osmo-hlr_10.42.42.2(pid=1550): stderr: | 20221209062144107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062144107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062144107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062144107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062144107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062144108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062144120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062144128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062144129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062144129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:47.321154 run osmo-msc_10.42.42.6(pid=1556): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1556)] 06:21:47.371620 run osmo-msc_10.42.42.6(pid=1556): stdout: | (launched: 2022-12-09_06:21:45.815793) 06:21:47.423357 run osmo-msc_10.42.42.6(pid=1556): stderr: | 20221209062146240 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062146240 DLGLOBAL DEBUG validating counter group 0x7f5a6ee13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062146240 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062146240 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062146240 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062146241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062146243 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062146243 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062146243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062146243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:47.475892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1549): Terminating (SIGTERM) 06:21:47.517582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1552): Terminating (SIGTERM) 06:21:47.559240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1555): Terminating (SIGTERM) 06:21:47.601743 --- ParallelTerminationStrategy: PID 1549 died... 06:21:47.621690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1549): Terminated: ok {rc=0} 06:21:47.667943 --- ParallelTerminationStrategy: PID 1552 died... 06:21:47.687593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1552): Terminated: ok {rc=0} 06:21:47.733621 --- ParallelTerminationStrategy: PID 1555 died... 06:21:47.753326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1555): Terminated: ok {rc=0} 06:21:47.841366 bus /sierra_3: Setting Powered False 06:21:48.939999 bus /sierra_3: Setting Powered False 06:21:50.057498 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:21:51.201547 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.213483 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:21:51.278642 tst mo_mt_call_osmux.py: using LAC 19534 06:21:51.397196 tst mo_mt_call_osmux.py: using RAC 154 06:21:51.518978 tst mo_mt_call_osmux.py: using CellId 19534 06:21:51.637253 tst mo_mt_call_osmux.py: using BVCI 19535 06:21:51.747270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.758682 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.770035 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.781499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.792903 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:21:51.804098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:51.922752 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:21:52.037960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:21:52.501718 run create_hlr_db(pid=1558): Launched 06:21:52.615336 bus /sierra_2: Setting Powered False 06:21:53.675152 run create_hlr_db(pid=1558): Terminated: ok {rc=0} 06:21:54.111858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Launched 06:21:54.430855 run osmo-hlr_10.42.42.2(pid=1561): Launched 06:21:54.553098 run osmo-stp_10.42.42.5: Starting osmo-stp 06:21:55.106356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Launched 06:21:55.424705 run osmo-stp_10.42.42.5(pid=1564): Launched 06:21:55.546475 run osmo-msc_10.42.42.6: Starting osmo-msc 06:21:56.126290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Launched 06:21:56.444502 run osmo-msc_10.42.42.6(pid=1567): Launched 06:21:56.624066 run osmo-stp_10.42.42.5(pid=1564): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] 06:21:56.761507 run osmo-stp_10.42.42.5(pid=1564): stdout: | (launched: 2022-12-09_06:21:55.366801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:56.897119 run osmo-stp_10.42.42.5(pid=1564): stderr: | 20221209062155557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062155557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062155557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062155558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062155558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062155558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062155558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:57.031822 run osmo-stp_10.42.42.5(pid=1564): stdout: | (launched: 2022-12-09_06:21:55.366801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:21:57.158626 run osmo-stp_10.42.42.5(pid=1564): stderr: | 20221209062155557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062155557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062155557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062155558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062155558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062155558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062155558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:21:57.310018 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1564): Process ended prematurely: osmo-stp_10.42.42.5(pid=1564) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:21:57.319197 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:21:57.347220 run osmo-hlr_10.42.42.2(pid=1561): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1561)] 06:21:57.397594 run osmo-hlr_10.42.42.2(pid=1561): stdout: | (launched: 2022-12-09_06:21:54.373234) 06:21:57.449742 run osmo-hlr_10.42.42.2(pid=1561): stderr: | 20221209062154570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062154570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062154570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062154570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062154570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062154570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062154582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062154591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062154591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062154591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:21:57.522713 run osmo-msc_10.42.42.6(pid=1567): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1567)] 06:21:57.573191 run osmo-msc_10.42.42.6(pid=1567): stdout: | (launched: 2022-12-09_06:21:56.386543) 06:21:57.625523 run osmo-msc_10.42.42.6(pid=1567): stderr: | 20221209062156707 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062156707 DLGLOBAL DEBUG validating counter group 0x7f9ad3b85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062156707 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062156707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062156708 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062156708 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062156709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062156710 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062156710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062156710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:21:57.678075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Terminating (SIGTERM) 06:21:57.720093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Terminating (SIGTERM) 06:21:57.762440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Terminating (SIGTERM) 06:21:57.804906 --- ParallelTerminationStrategy: PID 1560 died... 06:21:57.825096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1560): Terminated: ok {rc=0} 06:21:57.871730 --- ParallelTerminationStrategy: PID 1563 died... 06:21:57.891456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1563): Terminated: ok {rc=0} 06:21:57.937882 --- ParallelTerminationStrategy: PID 1566 died... 06:21:57.957643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1566): Terminated: ok {rc=0} 06:21:58.046210 bus /sierra_3: Setting Powered False 06:21:59.146186 bus /sierra_3: Setting Powered False 06:22:00.261754 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:22:01.513726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:01.527790 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:22:01.569869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:22:01.603900 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:22:01.667481 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:22:01.700462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:22:01.729190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:22:02.273566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:22:02.323875 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.334978 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:22:02.400328 tst mo_mt_call.py: using LAC 19535 06:22:02.521373 tst mo_mt_call.py: using RAC 155 06:22:02.642477 tst mo_mt_call.py: using CellId 19535 06:22:02.760390 tst mo_mt_call.py: using BVCI 19536 06:22:02.878111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.889805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.901368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.912711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.924472 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:02.936033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:22:03.049172 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:22:03.162240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:03.624542 run create_hlr_db(pid=1572): Launched 06:22:03.739694 bus /sierra_2: Setting Powered False 06:22:04.799327 run create_hlr_db(pid=1572): Terminated: ok {rc=0} 06:22:05.237212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1574): Launched 06:22:05.556602 run osmo-hlr_10.42.42.2(pid=1575): Launched 06:22:05.680333 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:06.234575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1577): Launched 06:22:06.552496 run osmo-stp_10.42.42.5(pid=1578): Launched 06:22:06.674973 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:07.257598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1580): Launched 06:22:07.576737 run osmo-msc_10.42.42.6(pid=1581): Launched 06:22:07.757469 run osmo-stp_10.42.42.5(pid=1578): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1578)] 06:22:07.892630 run osmo-stp_10.42.42.5(pid=1578): stdout: | (launched: 2022-12-09_06:22:06.494676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:08.028072 run osmo-stp_10.42.42.5(pid=1578): stderr: | 20221209062206686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062206686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062206686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062206687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062206687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062206687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062206687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:08.162811 run osmo-stp_10.42.42.5(pid=1578): stdout: | (launched: 2022-12-09_06:22:06.494676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:08.289693 run osmo-stp_10.42.42.5(pid=1578): stderr: | 20221209062206686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062206686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062206686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062206687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062206687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062206687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062206687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:08.441234 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1578): Process ended prematurely: osmo-stp_10.42.42.5(pid=1578) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1578)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:22:08.450814 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:22:08.478684 run osmo-hlr_10.42.42.2(pid=1575): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1575)] 06:22:08.528803 run osmo-hlr_10.42.42.2(pid=1575): stdout: | (launched: 2022-12-09_06:22:05.498581) 06:22:08.580695 run osmo-hlr_10.42.42.2(pid=1575): stderr: | 20221209062205697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062205698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062205698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062205698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062205698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062205698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062205710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062205718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062205718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062205719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:08.653533 run osmo-msc_10.42.42.6(pid=1581): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1581)] 06:22:08.703793 run osmo-msc_10.42.42.6(pid=1581): stdout: | (launched: 2022-12-09_06:22:07.518548) 06:22:08.755219 run osmo-msc_10.42.42.6(pid=1581): stderr: | 20221209062207839 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062207840 DLGLOBAL DEBUG validating counter group 0x7efd5d2efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062207840 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062207840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062207840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062207840 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062207842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062207842 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062207842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062207843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:08.807093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1574): Terminating (SIGTERM) 06:22:08.848590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1577): Terminating (SIGTERM) 06:22:08.890212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1580): Terminating (SIGTERM) 06:22:08.931820 --- ParallelTerminationStrategy: PID 1574 died... 06:22:08.951780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1574): Terminated: ok {rc=0} 06:22:08.998249 --- ParallelTerminationStrategy: PID 1577 died... 06:22:09.017815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1577): Terminated: ok {rc=0} 06:22:09.063921 --- ParallelTerminationStrategy: PID 1580 died... 06:22:09.083355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1580): Terminated: ok {rc=0} 06:22:09.170436 bus /sierra_3: Setting Powered False 06:22:10.269416 bus /sierra_3: Setting Powered False 06:22:11.385216 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:22:12.532753 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:12.545161 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:22:12.617877 tst mo_mt_call_osmux.py: using LAC 19536 06:22:12.744855 tst mo_mt_call_osmux.py: using RAC 156 06:22:12.869942 tst mo_mt_call_osmux.py: using CellId 19536 06:22:12.995348 tst mo_mt_call_osmux.py: using BVCI 19537 06:22:13.114380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:13.126213 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:13.137938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:13.150019 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:13.162202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:22:13.174286 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:22:13.290600 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:22:13.404304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:13.865956 run create_hlr_db(pid=1583): Launched 06:22:13.979544 bus /sierra_2: Setting Powered False 06:22:15.040264 run create_hlr_db(pid=1583): Terminated: ok {rc=0} 06:22:15.475632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Launched 06:22:15.794596 run osmo-hlr_10.42.42.2(pid=1586): Launched 06:22:16.002550 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:16.626927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Launched 06:22:16.968441 run osmo-stp_10.42.42.5(pid=1589): Launched 06:22:17.234669 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:17.802267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Launched 06:22:18.099347 run osmo-msc_10.42.42.6(pid=1592): Launched 06:22:18.265565 run osmo-stp_10.42.42.5(pid=1589): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] 06:22:18.392843 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_06:22:16.901873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:18.519411 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209062217157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062217157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062217158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062217158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062217160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062217160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062217160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:18.644301 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_06:22:16.901873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:18.763129 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209062217157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062217157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062217158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062217158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062217160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062217160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062217160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:18.905266 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:22:18.914096 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:22:18.940556 run osmo-hlr_10.42.42.2(pid=1586): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1586)] 06:22:18.989660 run osmo-hlr_10.42.42.2(pid=1586): stdout: | (launched: 2022-12-09_06:22:15.736450) 06:22:19.039450 run osmo-hlr_10.42.42.2(pid=1586): stderr: | 20221209062216024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062216024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062216024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062216024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062216024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062216024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062216043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062216066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062216066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062216066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:19.109169 run osmo-msc_10.42.42.6(pid=1592): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1592)] 06:22:19.157453 run osmo-msc_10.42.42.6(pid=1592): stdout: | (launched: 2022-12-09_06:22:18.044717) 06:22:19.207714 run osmo-msc_10.42.42.6(pid=1592): stderr: | 20221209062218316 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062218316 DLGLOBAL DEBUG validating counter group 0x7f4ea5976c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062218316 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062218317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062218317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062218317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062218319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062218319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062218320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062218320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:19.257937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminating (SIGTERM) 06:22:19.297597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminating (SIGTERM) 06:22:19.337765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminating (SIGTERM) 06:22:19.377986 --- ParallelTerminationStrategy: PID 1585 died... 06:22:19.397515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminated: ok {rc=0} 06:22:19.441999 --- ParallelTerminationStrategy: PID 1588 died... 06:22:19.460925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminated: ok {rc=0} 06:22:19.505351 --- ParallelTerminationStrategy: PID 1591 died... 06:22:19.524402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1591): Terminated: ok {rc=0} 06:22:19.610969 bus /sierra_3: Setting Powered False 06:22:20.709887 bus /sierra_3: Setting Powered False 06:22:21.825631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:22:23.074106 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:23.080931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:22:23.111974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:22:23.139094 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:22:23.190821 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:22:23.220631 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:22:23.247784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:22:23.801794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:22:23.852540 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:23.864181 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:22:23.930555 tst mo_mt_call.py: using LAC 19537 06:22:24.055510 tst mo_mt_call.py: using RAC 157 06:22:24.181061 tst mo_mt_call.py: using CellId 19537 06:22:24.305867 tst mo_mt_call.py: using BVCI 19538 06:22:24.422055 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:24.433809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:24.445250 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:24.456593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:24.468091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:24.479626 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:24.593299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:24.707344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:25.205093 run create_hlr_db(pid=1597): Launched 06:22:25.335380 bus /sierra_2: Setting Powered False 06:22:26.398349 run create_hlr_db(pid=1597): Terminated: ok {rc=0} 06:22:26.824830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Launched 06:22:27.123532 run osmo-hlr_10.42.42.2(pid=1600): Launched 06:22:27.237306 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:27.764639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Launched 06:22:28.061911 run osmo-stp_10.42.42.5(pid=1603): Launched 06:22:28.175810 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:28.714877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Launched 06:22:29.012738 run osmo-msc_10.42.42.6(pid=1606): Launched 06:22:29.179602 run osmo-stp_10.42.42.5(pid=1603): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] 06:22:29.316214 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-09_06:22:28.007373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:29.453282 run osmo-stp_10.42.42.5(pid=1603): stderr: | 20221209062228177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062228177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062228178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062228178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062228178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062228178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062228179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:29.587259 run osmo-stp_10.42.42.5(pid=1603): stdout: | (launched: 2022-12-09_06:22:28.007373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:29.715341 run osmo-stp_10.42.42.5(pid=1603): stderr: | 20221209062228177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062228177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062228178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062228178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062228178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062228178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062228179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:29.868068 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:22:29.877742 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 06:22:29.905731 run osmo-hlr_10.42.42.2(pid=1600): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1600)] 06:22:29.956095 run osmo-hlr_10.42.42.2(pid=1600): stdout: | (launched: 2022-12-09_06:22:27.069159) 06:22:30.007915 run osmo-hlr_10.42.42.2(pid=1600): stderr: | 20221209062227244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062227244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062227244 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062227244 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062227244 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062227244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062227256 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062227265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062227265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062227265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:30.080609 run osmo-msc_10.42.42.6(pid=1606): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1606)] 06:22:30.130798 run osmo-msc_10.42.42.6(pid=1606): stdout: | (launched: 2022-12-09_06:22:28.957842) 06:22:30.182385 run osmo-msc_10.42.42.6(pid=1606): stderr: | 20221209062229228 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062229228 DLGLOBAL DEBUG validating counter group 0x7f54ab42ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062229228 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062229228 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062229229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062229229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062229230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062229231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062229231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062229231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:30.234404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminating (SIGTERM) 06:22:30.275958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminating (SIGTERM) 06:22:30.317689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Terminating (SIGTERM) 06:22:30.359546 --- ParallelTerminationStrategy: PID 1599 died... 06:22:30.379603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1599): Terminated: ok {rc=0} 06:22:30.425783 --- ParallelTerminationStrategy: PID 1602 died... 06:22:30.445572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1602): Terminated: ok {rc=0} 06:22:30.491679 --- ParallelTerminationStrategy: PID 1605 died... 06:22:30.511395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1605): Terminated: ok {rc=0} 06:22:30.598779 bus /sierra_3: Setting Powered False 06:22:31.702521 bus /sierra_3: Setting Powered False 06:22:32.837157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:22:33.982320 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:33.994159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:22:34.060322 tst mo_mt_call_osmux.py: using LAC 19538 06:22:34.177752 tst mo_mt_call_osmux.py: using RAC 158 06:22:34.296646 tst mo_mt_call_osmux.py: using CellId 19538 06:22:34.412858 tst mo_mt_call_osmux.py: using BVCI 19539 06:22:34.520824 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:34.532288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:34.543243 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:34.554569 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:34.565914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:22:34.577198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:34.697750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:22:34.818684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:35.317922 run create_hlr_db(pid=1608): Launched 06:22:35.447581 bus /sierra_2: Setting Powered False 06:22:36.510850 run create_hlr_db(pid=1608): Terminated: ok {rc=0} 06:22:36.939998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1611): Launched 06:22:37.237659 run osmo-hlr_10.42.42.2(pid=1612): Launched 06:22:37.351219 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:37.878373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1614): Launched 06:22:38.177140 run osmo-stp_10.42.42.5(pid=1615): Launched 06:22:38.290346 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:38.842250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1617): Launched 06:22:39.140325 run osmo-msc_10.42.42.6(pid=1618): Launched 06:22:39.307568 run osmo-stp_10.42.42.5(pid=1615): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1615)] 06:22:39.435852 run osmo-stp_10.42.42.5(pid=1615): stdout: | (launched: 2022-12-09_06:22:38.122243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:39.563186 run osmo-stp_10.42.42.5(pid=1615): stderr: | 20221209062238294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062238294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062238294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062238295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062238295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062238295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062238295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:39.688191 run osmo-stp_10.42.42.5(pid=1615): stdout: | (launched: 2022-12-09_06:22:38.122243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:39.806605 run osmo-stp_10.42.42.5(pid=1615): stderr: | 20221209062238294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062238294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062238294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062238295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062238295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062238295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062238295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:39.948700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1615): Process ended prematurely: osmo-stp_10.42.42.5(pid=1615) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1615)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:22:39.957728 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:22:39.984641 run osmo-hlr_10.42.42.2(pid=1612): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1612)] 06:22:40.032922 run osmo-hlr_10.42.42.2(pid=1612): stdout: | (launched: 2022-12-09_06:22:37.183204) 06:22:40.082777 run osmo-hlr_10.42.42.2(pid=1612): stderr: | 20221209062237361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062237361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062237361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062237361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062237361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062237361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062237375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062237383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062237383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062237383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:40.152705 run osmo-msc_10.42.42.6(pid=1618): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1618)] 06:22:40.200918 run osmo-msc_10.42.42.6(pid=1618): stdout: | (launched: 2022-12-09_06:22:39.085440) 06:22:40.250731 run osmo-msc_10.42.42.6(pid=1618): stderr: | 20221209062239360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062239360 DLGLOBAL DEBUG validating counter group 0x7f8dc440ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062239360 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062239360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062239361 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062239361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062239362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062239363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062239363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062239363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:40.301174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1611): Terminating (SIGTERM) 06:22:40.341359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1614): Terminating (SIGTERM) 06:22:40.381905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1617): Terminating (SIGTERM) 06:22:40.422429 --- ParallelTerminationStrategy: PID 1611 died... 06:22:40.441737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1611): Terminated: ok {rc=0} 06:22:40.486744 --- ParallelTerminationStrategy: PID 1614 died... 06:22:40.505656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1614): Terminated: ok {rc=0} 06:22:40.550377 --- ParallelTerminationStrategy: PID 1617 died... 06:22:40.569374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1617): Terminated: ok {rc=0} 06:22:40.655960 bus /sierra_3: Setting Powered False 06:22:41.755496 bus /sierra_3: Setting Powered False 06:22:42.872544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:22:44.122090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:22:44.128693 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:22:44.158516 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:22:44.186589 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:22:44.238585 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:22:44.267968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:22:44.294840 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:22:44.852750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:22:44.903725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:44.915271 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:22:44.981767 tst mo_mt_call.py: using LAC 19539 06:22:45.117815 tst mo_mt_call.py: using RAC 159 06:22:45.245324 tst mo_mt_call.py: using CellId 19539 06:22:45.369971 tst mo_mt_call.py: using BVCI 19540 06:22:45.486415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:45.498051 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:45.509488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:45.520928 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:45.532565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:45.543945 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:45.658038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:45.771618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:46.334419 run create_hlr_db(pid=1624): Launched 06:22:46.487064 bus /sierra_2: Setting Powered False 06:22:47.549674 run create_hlr_db(pid=1624): Terminated: ok {rc=0} 06:22:47.997478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1626): Launched 06:22:48.316348 run osmo-hlr_10.42.42.2(pid=1627): Launched 06:22:48.437388 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:48.987316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1629): Launched 06:22:49.306238 run osmo-stp_10.42.42.5(pid=1630): Launched 06:22:49.428533 run osmo-msc_10.42.42.6: Starting osmo-msc 06:22:50.006257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1632): Launched 06:22:50.325636 run osmo-msc_10.42.42.6(pid=1633): Launched 06:22:50.505328 run osmo-stp_10.42.42.5(pid=1630): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1630)] 06:22:50.641998 run osmo-stp_10.42.42.5(pid=1630): stdout: | (launched: 2022-12-09_06:22:49.248580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:50.777599 run osmo-stp_10.42.42.5(pid=1630): stderr: | 20221209062249439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062249440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062249440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062249440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062249443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062249443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062249443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:50.912219 run osmo-stp_10.42.42.5(pid=1630): stdout: | (launched: 2022-12-09_06:22:49.248580) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:22:51.039163 run osmo-stp_10.42.42.5(pid=1630): stderr: | 20221209062249439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062249440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062249440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062249440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062249443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062249443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062249443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:22:51.191574 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1630): Process ended prematurely: osmo-stp_10.42.42.5(pid=1630) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1630)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:22:51.200929 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:22:51.228527 run osmo-hlr_10.42.42.2(pid=1627): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1627)] 06:22:51.278309 run osmo-hlr_10.42.42.2(pid=1627): stdout: | (launched: 2022-12-09_06:22:48.258491) 06:22:51.329741 run osmo-hlr_10.42.42.2(pid=1627): stderr: | 20221209062248456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062248456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062248456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062248456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062248456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062248456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062248468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062248476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062248477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062248477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:22:51.402105 run osmo-msc_10.42.42.6(pid=1633): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1633)] 06:22:51.451939 run osmo-msc_10.42.42.6(pid=1633): stdout: | (launched: 2022-12-09_06:22:50.267418) 06:22:51.503208 run osmo-msc_10.42.42.6(pid=1633): stderr: | 20221209062250590 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062250590 DLGLOBAL DEBUG validating counter group 0x7fb2f22b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062250591 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062250591 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062250591 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062250591 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062250593 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062250593 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062250593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062250593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:22:51.554995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1626): Terminating (SIGTERM) 06:22:51.596345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1629): Terminating (SIGTERM) 06:22:51.638081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1632): Terminating (SIGTERM) 06:22:51.679815 --- ParallelTerminationStrategy: PID 1626 died... 06:22:51.699428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1626): Terminated: ok {rc=0} 06:22:51.745300 --- ParallelTerminationStrategy: PID 1629 died... 06:22:51.764614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1629): Terminated: ok {rc=0} 06:22:51.810449 --- ParallelTerminationStrategy: PID 1632 died... 06:22:51.829980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1632): Terminated: ok {rc=0} 06:22:51.915736 bus /sierra_3: Setting Powered False 06:22:53.013523 bus /sierra_3: Setting Powered False 06:22:54.129084 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:22:55.274749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.286721 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:22:55.352859 tst mo_mt_call_osmux.py: using LAC 19540 06:22:55.480578 tst mo_mt_call_osmux.py: using RAC 160 06:22:55.608539 tst mo_mt_call_osmux.py: using CellId 19540 06:22:55.734278 tst mo_mt_call_osmux.py: using BVCI 19541 06:22:55.853308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.865164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.876656 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.888459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.900208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:22:55.911830 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:56.025889 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:22:56.141501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:22:56.604831 run create_hlr_db(pid=1636): Launched 06:22:56.719607 bus /sierra_2: Setting Powered False 06:22:57.780149 run create_hlr_db(pid=1636): Terminated: ok {rc=0} 06:22:58.198038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Launched 06:22:58.496666 run osmo-hlr_10.42.42.2(pid=1639): Launched 06:22:58.610902 run osmo-stp_10.42.42.5: Starting osmo-stp 06:22:59.141008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1641): Launched 06:22:59.439097 run osmo-stp_10.42.42.5(pid=1642): Launched 06:22:59.552771 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:00.092739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1644): Launched 06:23:00.391899 run osmo-msc_10.42.42.6(pid=1645): Launched 06:23:00.559973 run osmo-stp_10.42.42.5(pid=1642): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1642)] 06:23:00.688384 run osmo-stp_10.42.42.5(pid=1642): stdout: | (launched: 2022-12-09_06:22:59.384080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:00.815756 run osmo-stp_10.42.42.5(pid=1642): stderr: | 20221209062259551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062259551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062259551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062259552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062259554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062259554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062259554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:00.950410 run osmo-stp_10.42.42.5(pid=1642): stdout: | (launched: 2022-12-09_06:22:59.384080) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:01.082372 run osmo-stp_10.42.42.5(pid=1642): stderr: | 20221209062259551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062259551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062259551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062259552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062259554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062259554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062259554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:01.228001 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1642): Process ended prematurely: osmo-stp_10.42.42.5(pid=1642) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1642)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:23:01.237886 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:23:01.267708 run osmo-hlr_10.42.42.2(pid=1639): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1639)] 06:23:01.318345 run osmo-hlr_10.42.42.2(pid=1639): stdout: | (launched: 2022-12-09_06:22:58.441991) 06:23:01.370507 run osmo-hlr_10.42.42.2(pid=1639): stderr: | 20221209062258618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062258618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062258618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062258618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062258619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062258619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062258630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062258639 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062258639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062258639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:01.448091 run osmo-msc_10.42.42.6(pid=1645): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1645)] 06:23:01.510477 run osmo-msc_10.42.42.6(pid=1645): stdout: | (launched: 2022-12-09_06:23:00.337054) 06:23:01.571456 run osmo-msc_10.42.42.6(pid=1645): stderr: | 20221209062300609 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062300609 DLGLOBAL DEBUG validating counter group 0x7f963bfcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062300609 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062300609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062300609 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062300609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062300611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062300611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062300612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062300612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:01.632534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Terminating (SIGTERM) 06:23:01.681018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1641): Terminating (SIGTERM) 06:23:01.728858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1644): Terminating (SIGTERM) 06:23:01.780568 --- ParallelTerminationStrategy: PID 1638 died... 06:23:01.800540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Terminated: ok {rc=0} 06:23:01.854026 --- ParallelTerminationStrategy: PID 1641 died... 06:23:01.877546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1641): Terminated: ok {rc=0} 06:23:01.925904 --- ParallelTerminationStrategy: PID 1644 died... 06:23:01.954490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1644): Terminated: ok {rc=0} 06:23:02.055260 bus /sierra_3: Setting Powered False 06:23:03.178072 bus /sierra_3: Setting Powered False 06:23:04.317141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:23:05.569576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:05.576788 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:23:05.607574 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:23:05.635196 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:23:05.687459 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:23:05.719171 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:23:05.749073 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:23:06.297771 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:23:06.350037 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.363129 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:23:06.431277 tst mo_mt_call.py: using LAC 19541 06:23:06.556673 tst mo_mt_call.py: using RAC 161 06:23:06.679290 tst mo_mt_call.py: using CellId 19541 06:23:06.799893 tst mo_mt_call.py: using BVCI 19542 06:23:06.911626 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.924421 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.937850 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.951123 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.964570 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:06.977892 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:23:07.102966 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:23:07.216728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:07.729616 run create_hlr_db(pid=1924): Launched 06:23:07.891922 bus /sierra_2: Setting Powered False 06:23:08.958836 run create_hlr_db(pid=1924): Terminated: ok {rc=0} 06:23:09.428379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1926): Launched 06:23:09.783426 run osmo-hlr_10.42.42.2(pid=1927): Launched 06:23:10.038295 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:10.709622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1931): Launched 06:23:11.060487 run osmo-stp_10.42.42.5(pid=1932): Launched 06:23:11.304419 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:12.010789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1934): Launched 06:23:12.361893 run osmo-msc_10.42.42.6(pid=1935): Launched 06:23:12.732589 run osmo-stp_10.42.42.5(pid=1932): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1932)] 06:23:13.026472 run osmo-stp_10.42.42.5(pid=1932): stdout: | (launched: 2022-12-09_06:23:10.997273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:13.196834 run osmo-stp_10.42.42.5(pid=1932): stderr: | 20221209062311306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062311306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062311306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062311306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062311307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062311307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062311307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:13.337783 run osmo-stp_10.42.42.5(pid=1932): stdout: | (launched: 2022-12-09_06:23:10.997273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:13.472531 run osmo-stp_10.42.42.5(pid=1932): stderr: | 20221209062311306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062311306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062311306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062311306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062311307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062311307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062311307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:13.635222 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1932): Process ended prematurely: osmo-stp_10.42.42.5(pid=1932) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1932)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:23:13.646231 tst mo_mt_call.py:8: Test FAILED (7.3 sec) 06:23:13.676422 run osmo-hlr_10.42.42.2(pid=1927): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1927)] 06:23:13.730414 run osmo-hlr_10.42.42.2(pid=1927): stdout: | (launched: 2022-12-09_06:23:09.716452) 06:23:13.786382 run osmo-hlr_10.42.42.2(pid=1927): stderr: | 20221209062310036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062310036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062310036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062310036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062310036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062310036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062310056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062310068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062310068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062310077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:13.861723 run osmo-msc_10.42.42.6(pid=1935): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1935)] 06:23:13.913877 run osmo-msc_10.42.42.6(pid=1935): stdout: | (launched: 2022-12-09_06:23:12.297605) 06:23:13.968522 run osmo-msc_10.42.42.6(pid=1935): stderr: | 20221209062312810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062312810 DLGLOBAL DEBUG validating counter group 0x7ff2b36c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062312810 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062312810 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062312811 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062312811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062312812 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062312821 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062312821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062312821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:14.023365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1926): Terminating (SIGTERM) 06:23:14.068302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1931): Terminating (SIGTERM) 06:23:14.114395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1934): Terminating (SIGTERM) 06:23:14.161635 --- ParallelTerminationStrategy: PID 1926 died... 06:23:14.182978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1926): Terminated: ok {rc=0} 06:23:14.233869 --- ParallelTerminationStrategy: PID 1931 died... 06:23:14.254799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1931): Terminated: ok {rc=0} 06:23:14.304391 --- ParallelTerminationStrategy: PID 1934 died... 06:23:14.325382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1934): Terminated: ok {rc=0} 06:23:14.419451 bus /sierra_3: Setting Powered False 06:23:15.523785 bus /sierra_3: Setting Powered False 06:23:16.656173 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:23:17.821901 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:17.835038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:23:17.904571 tst mo_mt_call_osmux.py: using LAC 19542 06:23:18.029466 tst mo_mt_call_osmux.py: using RAC 162 06:23:18.153163 tst mo_mt_call_osmux.py: using CellId 19542 06:23:18.278447 tst mo_mt_call_osmux.py: using BVCI 19543 06:23:18.395132 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:18.407907 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:18.420254 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:18.434369 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:18.446821 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:23:18.460029 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:23:18.583726 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:23:18.705197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:19.201794 run create_hlr_db(pid=1937): Launched 06:23:19.363551 bus /sierra_2: Setting Powered False 06:23:20.425947 run create_hlr_db(pid=1937): Terminated: ok {rc=0} 06:23:20.873556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1939): Launched 06:23:21.210518 run osmo-hlr_10.42.42.2(pid=1940): Launched 06:23:21.452411 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:22.197389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1942): Launched 06:23:22.530372 run osmo-stp_10.42.42.5(pid=1943): Launched 06:23:22.781813 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:23.521690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Launched 06:23:23.849835 run osmo-msc_10.42.42.6(pid=1947): Launched 06:23:24.031677 run osmo-stp_10.42.42.5(pid=1943): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1943)] 06:23:24.170613 run osmo-stp_10.42.42.5(pid=1943): stdout: | (launched: 2022-12-09_06:23:22.468034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:24.308775 run osmo-stp_10.42.42.5(pid=1943): stderr: | 20221209062322808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062322808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062322813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062322813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062322814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062322819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062322819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:24.445881 run osmo-stp_10.42.42.5(pid=1943): stdout: | (launched: 2022-12-09_06:23:22.468034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:24.575620 run osmo-stp_10.42.42.5(pid=1943): stderr: | 20221209062322808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062322808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062322813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062322813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062322814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062322819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062322819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:24.731075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1943): Process ended prematurely: osmo-stp_10.42.42.5(pid=1943) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1943)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:23:24.740891 tst mo_mt_call_osmux.py:8: Test FAILED (7.0 sec) 06:23:24.768884 run osmo-hlr_10.42.42.2(pid=1940): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1940)] 06:23:24.819153 run osmo-hlr_10.42.42.2(pid=1940): stdout: | (launched: 2022-12-09_06:23:21.144647) 06:23:24.870991 run osmo-hlr_10.42.42.2(pid=1940): stderr: | 20221209062321495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062321495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062321495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062321495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062321495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062321495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062321515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062321530 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062321530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062321530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:24.943434 run osmo-msc_10.42.42.6(pid=1947): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1947)] 06:23:24.993737 run osmo-msc_10.42.42.6(pid=1947): stdout: | (launched: 2022-12-09_06:23:23.789737) 06:23:25.045850 run osmo-msc_10.42.42.6(pid=1947): stderr: | 20221209062324112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062324112 DLGLOBAL DEBUG validating counter group 0x7f739a353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062324112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062324112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062324112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062324113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062324114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062324115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062324115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062324115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:25.097980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1939): Terminating (SIGTERM) 06:23:25.139637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1942): Terminating (SIGTERM) 06:23:25.181608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Terminating (SIGTERM) 06:23:25.223984 --- ParallelTerminationStrategy: PID 1939 died... 06:23:25.244258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1939): Terminated: ok {rc=0} 06:23:25.290900 --- ParallelTerminationStrategy: PID 1942 died... 06:23:25.310827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1942): Terminated: ok {rc=0} 06:23:25.357254 --- ParallelTerminationStrategy: PID 1946 died... 06:23:25.376890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Terminated: ok {rc=0} 06:23:25.465369 bus /sierra_3: Setting Powered False 06:23:26.563848 bus /sierra_3: Setting Powered False 06:23:27.680127 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:23:28.936221 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:28.942589 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:23:28.972593 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:23:28.999931 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:23:29.053973 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:23:29.084365 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:23:29.112037 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:23:29.662936 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:23:29.716098 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:29.727884 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:23:29.795976 tst mo_mt_call.py: using LAC 19543 06:23:29.917235 tst mo_mt_call.py: using RAC 163 06:23:30.036781 tst mo_mt_call.py: using CellId 19543 06:23:30.157390 tst mo_mt_call.py: using BVCI 19544 06:23:30.277812 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:30.289666 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:30.301273 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:30.312744 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:30.324428 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:30.336128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:30.454315 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:30.572599 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:31.101558 run create_hlr_db(pid=1952): Launched 06:23:31.269660 bus /sierra_2: Setting Powered False 06:23:32.333675 run create_hlr_db(pid=1952): Terminated: ok {rc=0} 06:23:32.771357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Launched 06:23:33.078286 run osmo-hlr_10.42.42.2(pid=1955): Launched 06:23:33.194414 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:33.731238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Launched 06:23:34.037170 run osmo-stp_10.42.42.5(pid=1958): Launched 06:23:34.153213 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:34.705108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Launched 06:23:35.011022 run osmo-msc_10.42.42.6(pid=1961): Launched 06:23:35.182193 run osmo-stp_10.42.42.5(pid=1958): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] 06:23:35.312724 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-09_06:23:33.980089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:35.442691 run osmo-stp_10.42.42.5(pid=1958): stderr: | 20221209062334151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062334152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062334152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062334152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062334153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062334153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062334153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:35.570536 run osmo-stp_10.42.42.5(pid=1958): stdout: | (launched: 2022-12-09_06:23:33.980089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:35.691914 run osmo-stp_10.42.42.5(pid=1958): stderr: | 20221209062334151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062334152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062334152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062334152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062334153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062334153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062334153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:35.837314 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:23:35.846110 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:23:35.873417 run osmo-hlr_10.42.42.2(pid=1955): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1955)] 06:23:35.921942 run osmo-hlr_10.42.42.2(pid=1955): stdout: | (launched: 2022-12-09_06:23:33.021685) 06:23:35.972079 run osmo-hlr_10.42.42.2(pid=1955): stderr: | 20221209062333197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062333197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062333197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062333197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062333197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062333197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062333209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062333219 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062333219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062333219 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:36.042301 run osmo-msc_10.42.42.6(pid=1961): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1961)] 06:23:36.090613 run osmo-msc_10.42.42.6(pid=1961): stdout: | (launched: 2022-12-09_06:23:34.954236) 06:23:36.140758 run osmo-msc_10.42.42.6(pid=1961): stderr: | 20221209062335226 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062335226 DLGLOBAL DEBUG validating counter group 0x7f06b11b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062335226 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062335226 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062335227 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062335227 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062335228 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062335229 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062335229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062335229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:36.191223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminating (SIGTERM) 06:23:36.231404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminating (SIGTERM) 06:23:36.271862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Terminating (SIGTERM) 06:23:36.312622 --- ParallelTerminationStrategy: PID 1954 died... 06:23:36.332048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1954): Terminated: ok {rc=0} 06:23:36.376818 --- ParallelTerminationStrategy: PID 1957 died... 06:23:36.396173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1957): Terminated: ok {rc=0} 06:23:36.441455 --- ParallelTerminationStrategy: PID 1960 died... 06:23:36.460390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1960): Terminated: ok {rc=0} 06:23:36.545949 bus /sierra_3: Setting Powered False 06:23:37.643575 bus /sierra_3: Setting Powered False 06:23:38.761228 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:23:39.909951 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:39.921723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:23:39.988300 tst mo_mt_call_osmux.py: using LAC 19544 06:23:40.109994 tst mo_mt_call_osmux.py: using RAC 164 06:23:40.239504 tst mo_mt_call_osmux.py: using CellId 19544 06:23:40.370706 tst mo_mt_call_osmux.py: using BVCI 19545 06:23:40.483883 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:40.495166 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:40.506180 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:40.517336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:40.528474 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:23:40.539741 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:40.659325 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:23:40.775673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:41.251343 run create_hlr_db(pid=1963): Launched 06:23:41.367452 bus /sierra_2: Setting Powered False 06:23:42.427882 run create_hlr_db(pid=1963): Terminated: ok {rc=0} 06:23:42.853638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Launched 06:23:43.159701 run osmo-hlr_10.42.42.2(pid=1967): Launched 06:23:43.276028 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:43.799972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Launched 06:23:44.106826 run osmo-stp_10.42.42.5(pid=1970): Launched 06:23:44.224047 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:44.774232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Launched 06:23:45.080313 run osmo-msc_10.42.42.6(pid=1973): Launched 06:23:45.251563 run osmo-stp_10.42.42.5(pid=1970): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] 06:23:45.382116 run osmo-stp_10.42.42.5(pid=1970): stdout: | (launched: 2022-12-09_06:23:44.049888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:45.511798 run osmo-stp_10.42.42.5(pid=1970): stderr: | 20221209062344222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062344222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062344223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062344223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062344223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062344224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062344224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:45.639994 run osmo-stp_10.42.42.5(pid=1970): stdout: | (launched: 2022-12-09_06:23:44.049888) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:45.761293 run osmo-stp_10.42.42.5(pid=1970): stderr: | 20221209062344222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062344222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062344223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062344223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062344223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062344224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062344224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:45.946355 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1970): Process ended prematurely: osmo-stp_10.42.42.5(pid=1970) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:23:45.956813 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:23:45.991599 run osmo-hlr_10.42.42.2(pid=1967): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1967)] 06:23:46.057842 run osmo-hlr_10.42.42.2(pid=1967): stdout: | (launched: 2022-12-09_06:23:43.102606) 06:23:46.116430 run osmo-hlr_10.42.42.2(pid=1967): stderr: | 20221209062343280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062343280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062343280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062343280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062343280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062343280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062343306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062343316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062343317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062343317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:46.192006 run osmo-msc_10.42.42.6(pid=1973): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1973)] 06:23:46.244508 run osmo-msc_10.42.42.6(pid=1973): stdout: | (launched: 2022-12-09_06:23:45.023669) 06:23:46.298075 run osmo-msc_10.42.42.6(pid=1973): stderr: | 20221209062345296 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062345296 DLGLOBAL DEBUG validating counter group 0x7fc5a8c27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062345296 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062345296 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062345297 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062345297 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062345299 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062345299 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062345299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062345299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:46.352317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Terminating (SIGTERM) 06:23:46.397350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Terminating (SIGTERM) 06:23:46.445070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Terminating (SIGTERM) 06:23:46.495486 --- ParallelTerminationStrategy: PID 1966 died... 06:23:46.519112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Terminated: ok {rc=0} 06:23:46.576648 --- ParallelTerminationStrategy: PID 1969 died... 06:23:46.602084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Terminated: ok {rc=0} 06:23:46.650332 --- ParallelTerminationStrategy: PID 1972 died... 06:23:46.672065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Terminated: ok {rc=0} 06:23:46.765250 bus /sierra_3: Setting Powered False 06:23:47.867426 bus /sierra_3: Setting Powered False 06:23:48.983816 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 06:23:50.234393 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:23:50.239091 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:23:50.268942 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:23:50.296428 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:23:50.381193 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:23:50.411090 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:23:50.438411 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:23:51.028223 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 06:23:51.033401 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.044656 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:23:51.095984 tst emergency_mo_mt_call.py: using LAC 19545 06:23:51.221876 tst emergency_mo_mt_call.py: using RAC 165 06:23:51.349320 tst emergency_mo_mt_call.py: using CellId 19545 06:23:51.474844 tst emergency_mo_mt_call.py: using BVCI 19546 06:23:51.590951 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.603059 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.614241 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.625413 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.636548 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:23:51.647811 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:51.764139 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:23:51.877908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:23:52.344344 run create_hlr_db(pid=1978): Launched 06:23:52.460410 bus /sierra_2: Setting Powered False 06:23:53.521416 run create_hlr_db(pid=1978): Terminated: ok {rc=0} 06:23:53.942634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1980): Launched 06:23:54.243741 run osmo-hlr_10.42.42.2(pid=1981): Launched 06:23:54.358367 run osmo-stp_10.42.42.5: Starting osmo-stp 06:23:54.872604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1983): Launched 06:23:55.173182 run osmo-stp_10.42.42.5(pid=1984): Launched 06:23:55.297208 tst emergency_mo_mt_call.py: using MSISDN 7059 06:23:55.449868 run osmo-msc_10.42.42.6: Starting osmo-msc 06:23:55.992046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1986): Launched 06:23:56.292818 run osmo-msc_10.42.42.6(pid=1987): Launched 06:23:56.461535 run osmo-stp_10.42.42.5(pid=1984): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1984)] 06:23:56.589327 run osmo-stp_10.42.42.5(pid=1984): stdout: | (launched: 2022-12-09_06:23:55.117275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:56.717086 run osmo-stp_10.42.42.5(pid=1984): stderr: | 20221209062355286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062355286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062355286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062355287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062355289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062355289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062355290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:56.842177 run osmo-stp_10.42.42.5(pid=1984): stdout: | (launched: 2022-12-09_06:23:55.117275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:23:56.961110 run osmo-stp_10.42.42.5(pid=1984): stderr: | 20221209062355286 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062355286 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062355286 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062355287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062355289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062355289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062355290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:23:57.103252 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1984): Process ended prematurely: osmo-stp_10.42.42.5(pid=1984) [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1984)] [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 06:23:57.111655 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 06:23:57.138803 run osmo-hlr_10.42.42.2(pid=1981): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1981)] 06:23:57.187313 run osmo-hlr_10.42.42.2(pid=1981): stdout: | (launched: 2022-12-09_06:23:54.188115) 06:23:57.237669 run osmo-hlr_10.42.42.2(pid=1981): stderr: | 20221209062354367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062354367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062354367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062354367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062354367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062354367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062354380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062354390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062354390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062354390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:23:57.307501 run osmo-msc_10.42.42.6(pid=1987): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1987)] 06:23:57.356562 run osmo-msc_10.42.42.6(pid=1987): stdout: | (launched: 2022-12-09_06:23:56.237255) 06:23:57.406646 run osmo-msc_10.42.42.6(pid=1987): stderr: | 20221209062356510 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062356510 DLGLOBAL DEBUG validating counter group 0x7f4735a77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062356511 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062356511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062356511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062356512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062356513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062356514 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062356514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062356514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:23:57.457290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1980): Terminating (SIGTERM) 06:23:57.497767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1983): Terminating (SIGTERM) 06:23:57.538274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1986): Terminating (SIGTERM) 06:23:57.579232 --- ParallelTerminationStrategy: PID 1980 died... 06:23:57.598597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1980): Terminated: ok {rc=0} 06:23:57.643766 --- ParallelTerminationStrategy: PID 1983 died... 06:23:57.662798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1983): Terminated: ok {rc=0} 06:23:57.707718 --- ParallelTerminationStrategy: PID 1986 died... 06:23:57.726757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1986): Terminated: ok {rc=0} 06:23:57.812028 bus /sierra_3: Setting Powered False 06:23:58.911363 bus /sierra_3: Setting Powered False 06:24:00.028830 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 06:24:01.114026 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.127133 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:01.178481 tst emergency_preemptive_call.py: using LAC 19546 06:24:01.331583 tst emergency_preemptive_call.py: using RAC 166 06:24:01.452932 tst emergency_preemptive_call.py: using CellId 19546 06:24:01.597235 tst emergency_preemptive_call.py: using BVCI 19547 06:24:01.709204 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.721217 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.734062 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.747077 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.758921 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:24:01.773901 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:01.892353 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:02.012726 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:02.150534 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:02.268723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:02.737172 run create_hlr_db(pid=1989): Launched 06:24:02.851443 bus /sierra_2: Setting Powered False 06:24:03.911335 run create_hlr_db(pid=1989): Terminated: ok {rc=0} 06:24:04.352741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Launched 06:24:04.674785 run osmo-hlr_10.42.42.2(pid=1992): Launched 06:24:04.797705 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:05.354201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Launched 06:24:05.676148 run osmo-stp_10.42.42.5(pid=1995): Launched 06:24:05.812798 tst emergency_preemptive_call.py: using MSISDN 7060 06:24:05.976638 run osmo-msc_10.42.42.6: Starting osmo-msc 06:24:06.553665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Launched 06:24:06.875081 run osmo-msc_10.42.42.6(pid=1998): Launched 06:24:07.054633 run osmo-stp_10.42.42.5(pid=1995): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] 06:24:07.190112 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-09_06:24:05.617132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:07.325829 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221209062405817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062405817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062405817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062405817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062405818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062405818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062405818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:07.461028 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-09_06:24:05.617132) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:07.588833 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221209062405817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062405817 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062405817 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062405817 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062405818 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062405818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062405818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:07.742138 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 06:24:07.750908 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 06:24:07.778689 run osmo-hlr_10.42.42.2(pid=1992): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1992)] 06:24:07.829075 run osmo-hlr_10.42.42.2(pid=1992): stdout: | (launched: 2022-12-09_06:24:04.615717) 06:24:07.881316 run osmo-hlr_10.42.42.2(pid=1992): stderr: | 20221209062404816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062404816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062404816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062404816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062404816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062404816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062404828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062404836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062404836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062404837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:07.954094 run osmo-msc_10.42.42.6(pid=1998): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1998)] 06:24:08.004438 run osmo-msc_10.42.42.6(pid=1998): stdout: | (launched: 2022-12-09_06:24:06.815973) 06:24:08.056437 run osmo-msc_10.42.42.6(pid=1998): stderr: | 20221209062407137 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062407137 DLGLOBAL DEBUG validating counter group 0x7fcc3b279c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062407138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062407138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062407138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062407138 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062407141 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062407142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062407142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062407142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:24:08.108794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminating (SIGTERM) 06:24:08.150719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminating (SIGTERM) 06:24:08.192626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Terminating (SIGTERM) 06:24:08.235467 --- ParallelTerminationStrategy: PID 1991 died... 06:24:08.255606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminated: ok {rc=0} 06:24:08.301931 --- ParallelTerminationStrategy: PID 1994 died... 06:24:08.321616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminated: ok {rc=0} 06:24:08.367698 --- ParallelTerminationStrategy: PID 1997 died... 06:24:08.387281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Terminated: ok {rc=0} 06:24:08.475100 bus /sierra_9: Setting Powered False 06:24:09.574003 bus /sierra_9: Setting Powered False 06:24:10.690289 bus /sierra_8: Setting Powered False 06:24:11.789921 bus /sierra_8: Setting Powered False 06:24:12.905497 bus /sierra_3: Setting Powered False 06:24:14.002216 bus /sierra_3: Setting Powered False 06:24:15.119365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 06:24:16.432110 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:24:16.439422 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 06:24:16.471019 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 06:24:16.511405 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 06:24:16.601516 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 06:24:16.634878 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 06:24:16.675782 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 06:24:17.285776 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 06:24:17.339240 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.350558 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:17.396509 tst cs_paging_gprs_active.py: using LAC 19547 06:24:17.528610 tst cs_paging_gprs_active.py: using RAC 167 06:24:17.658434 tst cs_paging_gprs_active.py: using CellId 19547 06:24:17.788326 tst cs_paging_gprs_active.py: using BVCI 19548 06:24:17.901064 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.911877 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.922436 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.933320 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.943981 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.954751 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.965775 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.976464 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:17.987313 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:18.109198 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:18.229395 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:24:18.451159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:18.780553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Launched 06:24:19.065698 run iperf3-srv_10.42.42.10(pid=2004): Launched 06:24:19.188341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:24:19.408941 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:19.738435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Launched 06:24:20.023189 run iperf3-srv_10.42.42.10(pid=2006): Launched 06:24:20.146857 tst cs_paging_gprs_active.py:38: start network... 06:24:20.367073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:20.876315 run create_hlr_db(pid=2007): Launched 06:24:21.010591 bus /sierra_2: Setting Powered False 06:24:22.075298 run create_hlr_db(pid=2007): Terminated: ok {rc=0} 06:24:22.532684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Launched 06:24:22.861688 run osmo-hlr_10.42.42.2(pid=2010): Launched 06:24:22.986206 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:23.553223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Launched 06:24:23.881707 run osmo-stp_10.42.42.5(pid=2013): Launched 06:24:24.007988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:24.574489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Launched 06:24:24.702302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:24.979568 run patchelf(pid=2016): Launched 06:24:25.162374 run osmo-stp_10.42.42.5(pid=2013): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] 06:24:25.301628 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-09_06:24:23.821461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:25.442169 run osmo-stp_10.42.42.5(pid=2013): stderr: | 20221209062424016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062424016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062424017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062424017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062424017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062424017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062424018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:25.582635 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-09_06:24:23.821461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:25.717851 run osmo-stp_10.42.42.5(pid=2013): stderr: | 20221209062424016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062424016 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062424017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062424017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062424017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062424017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062424018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:25.877410 run patchelf(pid=2016): Terminating (SIGINT) 06:24:26.061490 run patchelf(pid=2016): Terminated: ok {rc=0} 06:24:26.194550 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2355↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] [trial-2355↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 06:24:26.204472 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 06:24:26.233145 run osmo-hlr_10.42.42.2(pid=2010): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2010)] 06:24:26.283261 run osmo-hlr_10.42.42.2(pid=2010): stdout: | (launched: 2022-12-09_06:24:22.801094) 06:24:26.335154 run osmo-hlr_10.42.42.2(pid=2010): stderr: | 20221209062423002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062423002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062423002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062423002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062423002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062423002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062423014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062423023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062423023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062423023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:26.387278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Terminating (SIGTERM) 06:24:26.429335 run iperf3-srv_10.42.42.10(pid=2004): Terminating (SIGTERM) 06:24:26.471347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Terminating (SIGTERM) 06:24:26.513367 run iperf3-srv_10.42.42.10(pid=2006): Terminating (SIGTERM) 06:24:26.555091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminating (SIGTERM) 06:24:26.596931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminating (SIGTERM) 06:24:26.638897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Terminating (SIGTERM) 06:24:26.681769 --- ParallelTerminationStrategy: PID 2003 died... 06:24:26.701977 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Terminated: ok {rc=0} 06:24:26.748475 --- ParallelTerminationStrategy: PID 2004 died... 06:24:26.768240 run iperf3-srv_10.42.42.10(pid=2004): Terminated {rc=256} 06:24:26.814581 --- ParallelTerminationStrategy: PID 2005 died... 06:24:26.834310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Terminated: ok {rc=0} 06:24:26.881054 --- ParallelTerminationStrategy: PID 2006 died... 06:24:26.900586 run iperf3-srv_10.42.42.10(pid=2006): Terminated {rc=256} 06:24:26.946752 --- ParallelTerminationStrategy: PID 2009 died... 06:24:26.966453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminated: ok {rc=0} 06:24:27.012535 --- ParallelTerminationStrategy: PID 2012 died... 06:24:27.032279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminated: ok {rc=0} 06:24:27.078600 --- ParallelTerminationStrategy: PID 2015 died... 06:24:27.098272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Terminated: ok {rc=0} 06:24:27.186398 bus /gobi_0: Setting Powered False 06:24:28.285674 bus /gobi_0: Setting Powered False 06:24:29.401353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 06:24:30.549091 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:30.560611 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:30.611615 tst iperf3.py: using LAC 19548 06:24:30.731255 tst iperf3.py: using RAC 168 06:24:30.857064 tst iperf3.py: using CellId 19548 06:24:30.991942 tst iperf3.py: using BVCI 19549 06:24:31.114663 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.127024 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.139236 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.151531 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.164172 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.175625 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.188413 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.200131 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:31.211890 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:31.334572 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:24:31.567601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:31.909532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2017): Launched 06:24:32.212418 run iperf3-srv_10.42.42.10(pid=2018): Launched 06:24:32.335624 tst iperf3.py:8: start network... 06:24:32.555961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:33.063792 run create_hlr_db(pid=2019): Launched 06:24:33.197242 bus /gobi_6: Setting Powered False 06:24:34.261584 run create_hlr_db(pid=2019): Terminated: ok {rc=0} 06:24:34.715567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Launched 06:24:35.042786 run osmo-hlr_10.42.42.2(pid=2022): Launched 06:24:35.167004 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:35.731084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Launched 06:24:36.059024 run osmo-stp_10.42.42.5(pid=2025): Launched 06:24:36.183610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:36.752419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2027): Launched 06:24:36.877414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:37.153847 run patchelf(pid=2028): Launched 06:24:37.335599 run osmo-stp_10.42.42.5(pid=2025): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] 06:24:37.474042 run osmo-stp_10.42.42.5(pid=2025): stdout: | (launched: 2022-12-09_06:24:35.998795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:37.613702 run osmo-stp_10.42.42.5(pid=2025): stderr: | 20221209062436194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062436194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062436194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062436195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062436195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062436195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062436195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:37.754238 run osmo-stp_10.42.42.5(pid=2025): stdout: | (launched: 2022-12-09_06:24:35.998795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:37.889336 run osmo-stp_10.42.42.5(pid=2025): stderr: | 20221209062436194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062436194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062436194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062436195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062436195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062436195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062436195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:38.048875 run patchelf(pid=2028): Terminating (SIGINT) 06:24:38.233171 run patchelf(pid=2028): Terminated: ok {rc=0} 06:24:38.365992 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 06:24:38.376008 tst iperf3.py:8: Test FAILED (7.9 sec) 06:24:38.404641 run osmo-hlr_10.42.42.2(pid=2022): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2022)] 06:24:38.454530 run osmo-hlr_10.42.42.2(pid=2022): stdout: | (launched: 2022-12-09_06:24:34.982504) 06:24:38.506168 run osmo-hlr_10.42.42.2(pid=2022): stderr: | 20221209062435184 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062435184 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062435184 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062435184 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062435184 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062435185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062435196 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062435205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062435205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062435205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:38.558320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2017): Terminating (SIGTERM) 06:24:38.600345 run iperf3-srv_10.42.42.10(pid=2018): Terminating (SIGTERM) 06:24:38.642316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminating (SIGTERM) 06:24:38.684381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminating (SIGTERM) 06:24:38.726827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2027): Terminating (SIGTERM) 06:24:38.769170 --- ParallelTerminationStrategy: PID 2017 died... 06:24:38.789359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2017): Terminated: ok {rc=0} 06:24:38.835732 --- ParallelTerminationStrategy: PID 2018 died... 06:24:38.855437 run iperf3-srv_10.42.42.10(pid=2018): Terminated {rc=256} 06:24:38.901770 --- ParallelTerminationStrategy: PID 2021 died... 06:24:38.921506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminated: ok {rc=0} 06:24:38.967866 --- ParallelTerminationStrategy: PID 2024 died... 06:24:38.987772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminated: ok {rc=0} 06:24:39.034070 --- ParallelTerminationStrategy: PID 2027 died... 06:24:39.053703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2027): Terminated: ok {rc=0} 06:24:39.141446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 06:24:40.289674 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.301214 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:24:40.347796 tst iperf3m4.py: using LAC 19549 06:24:40.469740 tst iperf3m4.py: using RAC 169 06:24:40.601585 tst iperf3m4.py: using CellId 19549 06:24:40.725137 tst iperf3m4.py: using BVCI 19550 06:24:40.837978 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.848871 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.859605 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.871013 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.882347 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.893599 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.905255 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.916272 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:24:40.927890 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:41.044491 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:41.166680 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:41.284660 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:24:41.405089 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:24:41.627174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:41.957323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2029): Launched 06:24:42.242601 run iperf3-srv_10.42.42.10(pid=2030): Launched 06:24:42.366723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:24:42.587232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:42.916123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Launched 06:24:43.201106 run iperf3-srv_10.42.42.10(pid=2032): Launched 06:24:43.323602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:24:43.543747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:43.872406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2033): Launched 06:24:44.157455 run iperf3-srv_10.42.42.10(pid=2034): Launched 06:24:44.280419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:24:44.501568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:24:44.831486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2035): Launched 06:24:45.116465 run iperf3-srv_10.42.42.10(pid=2036): Launched 06:24:45.239585 tst iperf3m4.py:8: start network... 06:24:45.459876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:24:45.970207 run create_hlr_db(pid=2037): Launched 06:24:46.128521 bus /gobi_6: Setting Powered False 06:24:47.189352 run create_hlr_db(pid=2037): Terminated: ok {rc=0} 06:24:47.621199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Launched 06:24:47.928173 run osmo-hlr_10.42.42.2(pid=2040): Launched 06:24:48.044333 run osmo-stp_10.42.42.5: Starting osmo-stp 06:24:48.683757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Launched 06:24:48.983244 run osmo-stp_10.42.42.5(pid=2043): Launched 06:24:49.097613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:24:49.614933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Launched 06:24:49.729242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:24:49.982905 run patchelf(pid=2046): Launched 06:24:50.149255 run osmo-stp_10.42.42.5(pid=2043): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] 06:24:50.277127 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-09_06:24:48.927663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:50.406300 run osmo-stp_10.42.42.5(pid=2043): stderr: | 20221209062449098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062449098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062449098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062449099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062449099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062449099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062449099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:50.535142 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-09_06:24:48.927663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:24:50.659010 run osmo-stp_10.42.42.5(pid=2043): stderr: | 20221209062449098 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062449098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062449098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062449099 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062449099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062449099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062449099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:24:50.805532 run patchelf(pid=2046): Terminating (SIGINT) 06:24:50.973830 run patchelf(pid=2046): Terminated: ok {rc=0} 06:24:51.095328 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2043): Process ended prematurely: osmo-stp_10.42.42.5(pid=2043) [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 06:24:51.104710 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:24:51.133016 run osmo-hlr_10.42.42.2(pid=2040): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2040)] 06:24:51.181272 run osmo-hlr_10.42.42.2(pid=2040): stdout: | (launched: 2022-12-09_06:24:47.871474) 06:24:51.231130 run osmo-hlr_10.42.42.2(pid=2040): stderr: | 20221209062448050 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062448050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062448050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062448050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062448050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062448050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062448060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062448069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062448069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062448069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:24:51.281314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2029): Terminating (SIGTERM) 06:24:51.321386 run iperf3-srv_10.42.42.10(pid=2030): Terminating (SIGTERM) 06:24:51.361568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Terminating (SIGTERM) 06:24:51.401620 run iperf3-srv_10.42.42.10(pid=2032): Terminating (SIGTERM) 06:24:51.441610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2033): Terminating (SIGTERM) 06:24:51.481864 run iperf3-srv_10.42.42.10(pid=2034): Terminating (SIGTERM) 06:24:51.521687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2035): Terminating (SIGTERM) 06:24:51.561748 run iperf3-srv_10.42.42.10(pid=2036): Terminating (SIGTERM) 06:24:51.601705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminating (SIGTERM) 06:24:51.641886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminating (SIGTERM) 06:24:51.681853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Terminating (SIGTERM) 06:24:51.722259 --- ParallelTerminationStrategy: PID 2029 died... 06:24:51.741231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2029): Terminated: ok {rc=0} 06:24:51.786215 --- ParallelTerminationStrategy: PID 2030 died... 06:24:51.804731 run iperf3-srv_10.42.42.10(pid=2030): Terminated {rc=256} 06:24:51.849485 --- ParallelTerminationStrategy: PID 2031 died... 06:24:51.868240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Terminated: ok {rc=0} 06:24:51.912791 --- ParallelTerminationStrategy: PID 2032 died... 06:24:51.931907 run iperf3-srv_10.42.42.10(pid=2032): Terminated {rc=256} 06:24:51.976415 --- ParallelTerminationStrategy: PID 2033 died... 06:24:51.995286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2033): Terminated: ok {rc=0} 06:24:52.039880 --- ParallelTerminationStrategy: PID 2034 died... 06:24:52.058625 run iperf3-srv_10.42.42.10(pid=2034): Terminated {rc=256} 06:24:52.103468 --- ParallelTerminationStrategy: PID 2035 died... 06:24:52.122290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2035): Terminated: ok {rc=0} 06:24:52.167164 --- ParallelTerminationStrategy: PID 2036 died... 06:24:52.185942 run iperf3-srv_10.42.42.10(pid=2036): Terminated {rc=256} 06:24:52.230255 --- ParallelTerminationStrategy: PID 2039 died... 06:24:52.249098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminated: ok {rc=0} 06:24:52.293166 --- ParallelTerminationStrategy: PID 2042 died... 06:24:52.312008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminated: ok {rc=0} 06:24:52.356760 --- ParallelTerminationStrategy: PID 2045 died... 06:24:52.375503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Terminated: ok {rc=0} 06:24:52.461995 bus /gobi_4: Setting Powered False 06:24:53.563197 bus /gobi_4: Setting Powered False 06:24:54.678318 bus /gobi_1: Setting Powered False 06:24:55.777056 bus /gobi_1: Setting Powered False 06:24:56.892282 bus /gobi_0: Setting Powered False 06:24:57.990671 bus /gobi_0: Setting Powered False 06:24:59.107246 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 06:25:00.209852 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.221679 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:00.267709 tst ping.py: using LAC 19550 06:25:00.397390 tst ping.py: using RAC 170 06:25:00.521228 tst ping.py: using CellId 19550 06:25:00.643264 tst ping.py: using BVCI 19551 06:25:00.758532 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.769706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.780739 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.791864 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.802834 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.813757 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.824809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:00.847776 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:00.979986 tst ping.py:19: start network... 06:25:01.268261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:01.792539 run create_hlr_db(pid=2050): Launched 06:25:01.950189 bus /gobi_6: Setting Powered False 06:25:03.013102 run create_hlr_db(pid=2050): Terminated: ok {rc=0} 06:25:03.455429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Launched 06:25:03.772197 run osmo-hlr_10.42.42.2(pid=2053): Launched 06:25:03.891822 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:04.441370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Launched 06:25:04.757986 run osmo-stp_10.42.42.5(pid=2056): Launched 06:25:04.876780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:05.417912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Launched 06:25:05.538457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:05.804911 run patchelf(pid=2059): Launched 06:25:05.981078 run osmo-stp_10.42.42.5(pid=2056): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] 06:25:06.115005 run osmo-stp_10.42.42.5(pid=2056): stdout: | (launched: 2022-12-09_06:25:04.699942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:06.250684 run osmo-stp_10.42.42.5(pid=2056): stderr: | 20221209062504895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062504895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062504895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062504896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062504896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062504896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062504896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:06.386244 run osmo-stp_10.42.42.5(pid=2056): stdout: | (launched: 2022-12-09_06:25:04.699942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:06.516156 run osmo-stp_10.42.42.5(pid=2056): stderr: | 20221209062504895 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062504895 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062504895 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062504896 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062504896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062504896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062504896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:06.669375 run patchelf(pid=2059): Terminating (SIGINT) 06:25:06.847239 run patchelf(pid=2059): Terminated: ok {rc=0} 06:25:06.974900 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2056): Process ended prematurely: osmo-stp_10.42.42.5(pid=2056) [trial-2355↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] [trial-2355↪gprs:trx-lms-limenet-micro↪ping.py:22] 06:25:06.984041 tst ping.py:22: Test FAILED (6.8 sec) 06:25:07.011971 run osmo-hlr_10.42.42.2(pid=2053): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2053)] 06:25:07.062098 run osmo-hlr_10.42.42.2(pid=2053): stdout: | (launched: 2022-12-09_06:25:03.714215) 06:25:07.114096 run osmo-hlr_10.42.42.2(pid=2053): stderr: | 20221209062503913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062503913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062503913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062503913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062503913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062503913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062503926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062503936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062503936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062503936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:07.166839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Terminating (SIGTERM) 06:25:07.208821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Terminating (SIGTERM) 06:25:07.251006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Terminating (SIGTERM) 06:25:07.293254 --- ParallelTerminationStrategy: PID 2052 died... 06:25:07.313356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2052): Terminated: ok {rc=0} 06:25:07.359748 --- ParallelTerminationStrategy: PID 2055 died... 06:25:07.379185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2055): Terminated: ok {rc=0} 06:25:07.425395 --- ParallelTerminationStrategy: PID 2058 died... 06:25:07.445037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2058): Terminated: ok {rc=0} 06:25:07.532068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 06:25:08.618423 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:08.630203 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 06:25:08.677468 tst ping_idle_ping.py: using LAC 19551 06:25:08.796025 tst ping_idle_ping.py: using RAC 171 06:25:08.911402 tst ping_idle_ping.py: using CellId 19551 06:25:09.026852 tst ping_idle_ping.py: using BVCI 19552 06:25:09.135721 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.146537 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.157343 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.168145 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.178967 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.189862 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.200710 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 06:25:09.211636 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 06:25:09.324779 tst ping_idle_ping.py:24: start network... 06:25:09.523067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:09.983442 run create_hlr_db(pid=2060): Launched 06:25:10.095289 bus /gobi_6: Setting Powered False 06:25:11.154554 run create_hlr_db(pid=2060): Terminated: ok {rc=0} 06:25:11.589953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Launched 06:25:11.906725 run osmo-hlr_10.42.42.2(pid=2063): Launched 06:25:12.026465 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:12.575308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Launched 06:25:12.893674 run osmo-stp_10.42.42.5(pid=2066): Launched 06:25:13.013843 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:13.562680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2068): Launched 06:25:13.684860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:13.953661 run patchelf(pid=2069): Launched 06:25:14.130364 run osmo-stp_10.42.42.5(pid=2066): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] 06:25:14.265688 run osmo-stp_10.42.42.5(pid=2066): stdout: | (launched: 2022-12-09_06:25:12.835484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:14.402454 run osmo-stp_10.42.42.5(pid=2066): stderr: | 20221209062513026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062513026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062513026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062513026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062513027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062513027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062513027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:14.539282 run osmo-stp_10.42.42.5(pid=2066): stdout: | (launched: 2022-12-09_06:25:12.835484) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:14.669624 run osmo-stp_10.42.42.5(pid=2066): stderr: | 20221209062513026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062513026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062513026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062513026 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062513027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062513027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062513027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:14.824584 run patchelf(pid=2069): Terminating (SIGINT) 06:25:15.002840 run patchelf(pid=2069): Terminated: ok {rc=0} 06:25:15.131413 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2066): Process ended prematurely: osmo-stp_10.42.42.5(pid=2066) [trial-2355↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] [trial-2355↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 06:25:15.140753 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:25:15.168992 run osmo-hlr_10.42.42.2(pid=2063): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2063)] 06:25:15.219108 run osmo-hlr_10.42.42.2(pid=2063): stdout: | (launched: 2022-12-09_06:25:11.848835) 06:25:15.270984 run osmo-hlr_10.42.42.2(pid=2063): stderr: | 20221209062512045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062512046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062512046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062512046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062512046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062512046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062512058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062512066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062512067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062512067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:15.323466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Terminating (SIGTERM) 06:25:15.365476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Terminating (SIGTERM) 06:25:15.407640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2068): Terminating (SIGTERM) 06:25:15.449938 --- ParallelTerminationStrategy: PID 2062 died... 06:25:15.469998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2062): Terminated: ok {rc=0} 06:25:15.516424 --- ParallelTerminationStrategy: PID 2065 died... 06:25:15.536098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2065): Terminated: ok {rc=0} 06:25:15.582445 --- ParallelTerminationStrategy: PID 2068 died... 06:25:15.602126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2068): Terminated: ok {rc=0} 06:25:15.689512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 06:25:17.036457 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:25:17.042242 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:25:17.076115 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:25:17.117023 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:25:17.207354 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:25:17.237870 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:25:17.278060 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:25:17.875787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:25:17.927510 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:17.938934 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:17.985851 tst cs_paging_gprs_active.py: using LAC 19552 06:25:18.113260 tst cs_paging_gprs_active.py: using RAC 172 06:25:18.238974 tst cs_paging_gprs_active.py: using CellId 19552 06:25:18.365475 tst cs_paging_gprs_active.py: using BVCI 19553 06:25:18.482179 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.493792 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.505065 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.516325 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.527516 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.539085 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.550467 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.562135 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:18.576798 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:18.699942 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:18.821268 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:25:19.038611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:19.362053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Launched 06:25:19.642677 run iperf3-srv_10.42.42.10(pid=2075): Launched 06:25:19.764787 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:25:19.981413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:20.305242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Launched 06:25:20.586628 run iperf3-srv_10.42.42.10(pid=2077): Launched 06:25:20.707887 tst cs_paging_gprs_active.py:38: start network... 06:25:20.924809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:21.424427 run create_hlr_db(pid=2078): Launched 06:25:21.555737 bus /gobi_6: Setting Powered False 06:25:22.619492 run create_hlr_db(pid=2078): Terminated: ok {rc=0} 06:25:23.069256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Launched 06:25:23.390616 run osmo-hlr_10.42.42.2(pid=2081): Launched 06:25:23.513193 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:24.067662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Launched 06:25:24.390570 run osmo-stp_10.42.42.5(pid=2084): Launched 06:25:24.513068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:25.073204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2086): Launched 06:25:25.197239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:25.470249 run patchelf(pid=2087): Launched 06:25:25.649409 run osmo-stp_10.42.42.5(pid=2084): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] 06:25:25.786842 run osmo-stp_10.42.42.5(pid=2084): stdout: | (launched: 2022-12-09_06:25:24.331311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:25.925214 run osmo-stp_10.42.42.5(pid=2084): stderr: | 20221209062524525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062524525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062524525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062524526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062524526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062524526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062524526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:26.063508 run osmo-stp_10.42.42.5(pid=2084): stdout: | (launched: 2022-12-09_06:25:24.331311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:26.196190 run osmo-stp_10.42.42.5(pid=2084): stderr: | 20221209062524525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062524525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062524525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062524526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062524526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062524526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062524526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:26.353709 run patchelf(pid=2087): Terminating (SIGINT) 06:25:26.534609 run patchelf(pid=2087): Terminated: ok {rc=0} 06:25:26.666177 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2084): Process ended prematurely: osmo-stp_10.42.42.5(pid=2084) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:25:26.676221 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:25:26.704933 run osmo-hlr_10.42.42.2(pid=2081): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2081)] 06:25:26.755448 run osmo-hlr_10.42.42.2(pid=2081): stdout: | (launched: 2022-12-09_06:25:23.331698) 06:25:26.807638 run osmo-hlr_10.42.42.2(pid=2081): stderr: | 20221209062523529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062523529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062523529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062523529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062523529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062523529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062523541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062523549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062523549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062523549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:26.860182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Terminating (SIGTERM) 06:25:26.902326 run iperf3-srv_10.42.42.10(pid=2075): Terminating (SIGTERM) 06:25:26.944581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Terminating (SIGTERM) 06:25:26.987331 run iperf3-srv_10.42.42.10(pid=2077): Terminating (SIGTERM) 06:25:27.029617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Terminating (SIGTERM) 06:25:27.071944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Terminating (SIGTERM) 06:25:27.114128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2086): Terminating (SIGTERM) 06:25:27.156607 --- ParallelTerminationStrategy: PID 2074 died... 06:25:27.176875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2074): Terminated: ok {rc=0} 06:25:27.223887 --- ParallelTerminationStrategy: PID 2075 died... 06:25:27.243609 run iperf3-srv_10.42.42.10(pid=2075): Terminated {rc=256} 06:25:27.290068 --- ParallelTerminationStrategy: PID 2076 died... 06:25:27.309788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2076): Terminated: ok {rc=0} 06:25:27.356285 --- ParallelTerminationStrategy: PID 2077 died... 06:25:27.376011 run iperf3-srv_10.42.42.10(pid=2077): Terminated {rc=256} 06:25:27.422444 --- ParallelTerminationStrategy: PID 2080 died... 06:25:27.442178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2080): Terminated: ok {rc=0} 06:25:27.488743 --- ParallelTerminationStrategy: PID 2083 died... 06:25:27.508426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2083): Terminated: ok {rc=0} 06:25:27.555379 --- ParallelTerminationStrategy: PID 2086 died... 06:25:27.575156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2086): Terminated: ok {rc=0} 06:25:27.663470 bus /gobi_0: Setting Powered False 06:25:28.764114 bus /gobi_0: Setting Powered False 06:25:29.881880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:25:31.038277 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.050802 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:31.100149 tst iperf3.py: using LAC 19553 06:25:31.261583 tst iperf3.py: using RAC 173 06:25:31.386662 tst iperf3.py: using CellId 19553 06:25:31.545469 tst iperf3.py: using BVCI 19554 06:25:31.690399 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.702708 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.714835 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.728696 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.740122 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.752351 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.765719 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.777710 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:31.789978 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:31.916316 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:32.137823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:32.463003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Launched 06:25:32.743009 run iperf3-srv_10.42.42.10(pid=2089): Launched 06:25:32.863536 tst iperf3.py:8: start network... 06:25:33.078651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:33.573692 run create_hlr_db(pid=2090): Launched 06:25:33.705218 bus /gobi_6: Setting Powered False 06:25:34.769401 run create_hlr_db(pid=2090): Terminated: ok {rc=0} 06:25:35.213632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Launched 06:25:35.532444 run osmo-hlr_10.42.42.2(pid=2093): Launched 06:25:35.654266 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:36.207913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Launched 06:25:36.525992 run osmo-stp_10.42.42.5(pid=2096): Launched 06:25:36.646646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:37.197545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Launched 06:25:37.319576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:37.589647 run patchelf(pid=2099): Launched 06:25:37.767040 run osmo-stp_10.42.42.5(pid=2096): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] 06:25:37.902382 run osmo-stp_10.42.42.5(pid=2096): stdout: | (launched: 2022-12-09_06:25:36.467590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:38.038794 run osmo-stp_10.42.42.5(pid=2096): stderr: | 20221209062536661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062536661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062536661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062536662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062536663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062536663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062536663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:38.175678 run osmo-stp_10.42.42.5(pid=2096): stdout: | (launched: 2022-12-09_06:25:36.467590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:38.307434 run osmo-stp_10.42.42.5(pid=2096): stderr: | 20221209062536661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062536661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062536661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062536662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062536663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062536663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062536663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:38.463334 run patchelf(pid=2099): Terminating (SIGINT) 06:25:38.642382 run patchelf(pid=2099): Terminated: ok {rc=0} 06:25:38.772630 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2096): Process ended prematurely: osmo-stp_10.42.42.5(pid=2096) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 06:25:38.782803 tst iperf3.py:8: Test FAILED (7.8 sec) 06:25:38.811165 run osmo-hlr_10.42.42.2(pid=2093): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2093)] 06:25:38.865935 run osmo-hlr_10.42.42.2(pid=2093): stdout: | (launched: 2022-12-09_06:25:35.473985) 06:25:38.917684 run osmo-hlr_10.42.42.2(pid=2093): stderr: | 20221209062535674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062535674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062535674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062535675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062535675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062535675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062535688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062535696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062535696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062535696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:38.969638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Terminating (SIGTERM) 06:25:39.011751 run iperf3-srv_10.42.42.10(pid=2089): Terminating (SIGTERM) 06:25:39.053953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Terminating (SIGTERM) 06:25:39.096155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Terminating (SIGTERM) 06:25:39.138696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Terminating (SIGTERM) 06:25:39.181114 --- ParallelTerminationStrategy: PID 2088 died... 06:25:39.201272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Terminated: ok {rc=0} 06:25:39.248229 --- ParallelTerminationStrategy: PID 2089 died... 06:25:39.267868 run iperf3-srv_10.42.42.10(pid=2089): Terminated {rc=256} 06:25:39.314025 --- ParallelTerminationStrategy: PID 2092 died... 06:25:39.334022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2092): Terminated: ok {rc=0} 06:25:39.380553 --- ParallelTerminationStrategy: PID 2095 died... 06:25:39.400197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2095): Terminated: ok {rc=0} 06:25:39.446493 --- ParallelTerminationStrategy: PID 2098 died... 06:25:39.466183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2098): Terminated: ok {rc=0} 06:25:39.553423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:25:40.702426 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:40.713997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:25:40.758292 tst iperf3m4.py: using LAC 19554 06:25:40.877052 tst iperf3m4.py: using RAC 174 06:25:40.993356 tst iperf3m4.py: using CellId 19554 06:25:41.111022 tst iperf3m4.py: using BVCI 19555 06:25:41.219765 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.230698 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.241489 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.252324 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.263265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.274297 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.285254 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.295947 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:25:41.306694 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:41.430094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:41.544690 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:41.665154 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:25:41.782911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:25:41.997217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:42.314020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Launched 06:25:42.589805 run iperf3-srv_10.42.42.10(pid=2101): Launched 06:25:42.708734 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:25:42.922841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:43.239819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Launched 06:25:43.515493 run iperf3-srv_10.42.42.10(pid=2103): Launched 06:25:43.634473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:25:43.847792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:44.164455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Launched 06:25:44.440004 run iperf3-srv_10.42.42.10(pid=2105): Launched 06:25:44.558638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:25:44.772712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:25:45.090039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2106): Launched 06:25:45.365581 run iperf3-srv_10.42.42.10(pid=2107): Launched 06:25:45.483810 tst iperf3m4.py:8: start network... 06:25:45.696460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:25:46.200593 run create_hlr_db(pid=2108): Launched 06:25:46.378948 bus /gobi_6: Setting Powered False 06:25:47.438857 run create_hlr_db(pid=2108): Terminated: ok {rc=0} 06:25:47.873146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2110): Launched 06:25:48.189163 run osmo-hlr_10.42.42.2(pid=2111): Launched 06:25:48.308909 run osmo-stp_10.42.42.5: Starting osmo-stp 06:25:48.860152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2113): Launched 06:25:49.176668 run osmo-stp_10.42.42.5(pid=2114): Launched 06:25:49.296539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:25:49.842337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2116): Launched 06:25:49.963189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:25:50.230764 run patchelf(pid=2117): Launched 06:25:50.406977 run osmo-stp_10.42.42.5(pid=2114): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2114)] 06:25:50.542296 run osmo-stp_10.42.42.5(pid=2114): stdout: | (launched: 2022-12-09_06:25:49.118923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:50.678629 run osmo-stp_10.42.42.5(pid=2114): stderr: | 20221209062549308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062549308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062549308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062549309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062549309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062549309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062549309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:50.815706 run osmo-stp_10.42.42.5(pid=2114): stdout: | (launched: 2022-12-09_06:25:49.118923) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:25:50.947205 run osmo-stp_10.42.42.5(pid=2114): stderr: | 20221209062549308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062549308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062549308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062549309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062549309 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062549309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062549309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:25:51.103060 run patchelf(pid=2117): Terminating (SIGINT) 06:25:51.281358 run patchelf(pid=2117): Terminated: ok {rc=0} 06:25:51.409728 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2114): Process ended prematurely: osmo-stp_10.42.42.5(pid=2114) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2114)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 06:25:51.419825 tst iperf3m4.py:8: Test FAILED (10.8 sec) 06:25:51.448329 run osmo-hlr_10.42.42.2(pid=2111): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2111)] 06:25:51.498396 run osmo-hlr_10.42.42.2(pid=2111): stdout: | (launched: 2022-12-09_06:25:48.131499) 06:25:51.550539 run osmo-hlr_10.42.42.2(pid=2111): stderr: | 20221209062548329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062548329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062548329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062548329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062548329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062548329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062548342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062548351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062548351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062548351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:25:51.602632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Terminating (SIGTERM) 06:25:51.644519 run iperf3-srv_10.42.42.10(pid=2101): Terminating (SIGTERM) 06:25:51.686457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Terminating (SIGTERM) 06:25:51.728786 run iperf3-srv_10.42.42.10(pid=2103): Terminating (SIGTERM) 06:25:51.771152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Terminating (SIGTERM) 06:25:51.813137 run iperf3-srv_10.42.42.10(pid=2105): Terminating (SIGTERM) 06:25:51.854815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2106): Terminating (SIGTERM) 06:25:51.896611 run iperf3-srv_10.42.42.10(pid=2107): Terminating (SIGTERM) 06:25:51.938293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2110): Terminating (SIGTERM) 06:25:51.980072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2113): Terminating (SIGTERM) 06:25:52.021911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2116): Terminating (SIGTERM) 06:25:52.063797 --- ParallelTerminationStrategy: PID 2100 died... 06:25:52.083935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Terminated: ok {rc=0} 06:25:52.129999 --- ParallelTerminationStrategy: PID 2101 died... 06:25:52.149438 run iperf3-srv_10.42.42.10(pid=2101): Terminated {rc=256} 06:25:52.195213 --- ParallelTerminationStrategy: PID 2102 died... 06:25:52.214793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2102): Terminated: ok {rc=0} 06:25:52.260601 --- ParallelTerminationStrategy: PID 2103 died... 06:25:52.279872 run iperf3-srv_10.42.42.10(pid=2103): Terminated {rc=256} 06:25:52.325747 --- ParallelTerminationStrategy: PID 2104 died... 06:25:52.345287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2104): Terminated: ok {rc=0} 06:25:52.391730 --- ParallelTerminationStrategy: PID 2105 died... 06:25:52.411153 run iperf3-srv_10.42.42.10(pid=2105): Terminated {rc=256} 06:25:52.456815 --- ParallelTerminationStrategy: PID 2106 died... 06:25:52.476648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2106): Terminated: ok {rc=0} 06:25:52.522542 --- ParallelTerminationStrategy: PID 2107 died... 06:25:52.542055 run iperf3-srv_10.42.42.10(pid=2107): Terminated {rc=256} 06:25:52.588637 --- ParallelTerminationStrategy: PID 2110 died... 06:25:52.608314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2110): Terminated: ok {rc=0} 06:25:52.654001 --- ParallelTerminationStrategy: PID 2113 died... 06:25:52.673448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2113): Terminated: ok {rc=0} 06:25:52.719493 --- ParallelTerminationStrategy: PID 2116 died... 06:25:52.739155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2116): Terminated: ok {rc=0} 06:25:52.826843 bus /gobi_4: Setting Powered False 06:25:53.927400 bus /gobi_4: Setting Powered False 06:25:55.042898 bus /gobi_1: Setting Powered False 06:25:56.142185 bus /gobi_1: Setting Powered False 06:25:57.257919 bus /gobi_0: Setting Powered False 06:25:58.357884 bus /gobi_0: Setting Powered False 06:25:59.473923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 06:26:00.573450 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:00.584939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:26:00.632055 tst ping.py: using LAC 19555 06:26:00.746371 tst ping.py: using RAC 175 06:26:00.871786 tst ping.py: using CellId 19555 06:26:01.000715 tst ping.py: using BVCI 19556 06:26:01.109502 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.121637 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.134207 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.146789 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.158554 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.171042 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.183942 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:01.196159 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:01.312069 tst ping.py:19: start network... 06:26:01.551413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:02.053017 run create_hlr_db(pid=2118): Launched 06:26:02.210159 bus /gobi_6: Setting Powered False 06:26:03.272212 run create_hlr_db(pid=2118): Terminated: ok {rc=0} 06:26:03.705066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Launched 06:26:04.014561 run osmo-hlr_10.42.42.2(pid=2121): Launched 06:26:04.131482 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:04.665845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Launched 06:26:04.976303 run osmo-stp_10.42.42.5(pid=2124): Launched 06:26:05.094075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:05.629102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Launched 06:26:05.748688 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:06.010459 run patchelf(pid=2127): Launched 06:26:06.183707 run osmo-stp_10.42.42.5(pid=2124): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] 06:26:06.316289 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-09_06:26:04.919655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:06.450456 run osmo-stp_10.42.42.5(pid=2124): stderr: | 20221209062605110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062605110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062605111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062605111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062605112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062605112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062605112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:06.584473 run osmo-stp_10.42.42.5(pid=2124): stdout: | (launched: 2022-12-09_06:26:04.919655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:06.712653 run osmo-stp_10.42.42.5(pid=2124): stderr: | 20221209062605110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062605110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062605111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062605111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062605112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062605112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062605112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:06.864323 run patchelf(pid=2127): Terminating (SIGINT) 06:26:07.040025 run patchelf(pid=2127): Terminated: ok {rc=0} 06:26:07.165968 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 06:26:07.175289 tst ping.py:22: Test FAILED (6.6 sec) 06:26:07.202992 run osmo-hlr_10.42.42.2(pid=2121): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2121)] 06:26:07.253205 run osmo-hlr_10.42.42.2(pid=2121): stdout: | (launched: 2022-12-09_06:26:03.958603) 06:26:07.305205 run osmo-hlr_10.42.42.2(pid=2121): stderr: | 20221209062604153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062604153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062604153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062604154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062604154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062604154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062604167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062604177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062604178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062604178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:07.357584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminating (SIGTERM) 06:26:07.399596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminating (SIGTERM) 06:26:07.441830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminating (SIGTERM) 06:26:07.483969 --- ParallelTerminationStrategy: PID 2120 died... 06:26:07.504022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2120): Terminated: ok {rc=0} 06:26:07.550644 --- ParallelTerminationStrategy: PID 2123 died... 06:26:07.570330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2123): Terminated: ok {rc=0} 06:26:07.616427 --- ParallelTerminationStrategy: PID 2126 died... 06:26:07.635987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2126): Terminated: ok {rc=0} 06:26:07.724160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:26:08.811744 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:08.823680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:26:08.871847 tst ping_idle_ping.py: using LAC 19556 06:26:08.996715 tst ping_idle_ping.py: using RAC 176 06:26:09.120259 tst ping_idle_ping.py: using CellId 19556 06:26:09.242454 tst ping_idle_ping.py: using BVCI 19557 06:26:09.356712 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.368284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.379510 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.390790 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.401997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.413079 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.424424 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:26:09.435617 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:26:09.548553 tst ping_idle_ping.py:24: start network... 06:26:09.741610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:10.192166 run create_hlr_db(pid=2128): Launched 06:26:10.303774 bus /gobi_6: Setting Powered False 06:26:11.362009 run create_hlr_db(pid=2128): Terminated: ok {rc=0} 06:26:11.789515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2130): Launched 06:26:12.100507 run osmo-hlr_10.42.42.2(pid=2131): Launched 06:26:12.218849 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:12.759025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2133): Launched 06:26:13.069475 run osmo-stp_10.42.42.5(pid=2134): Launched 06:26:13.187654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:13.724247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2136): Launched 06:26:13.843965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:14.105441 run patchelf(pid=2137): Launched 06:26:14.278707 run osmo-stp_10.42.42.5(pid=2134): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2134)] 06:26:14.411324 run osmo-stp_10.42.42.5(pid=2134): stdout: | (launched: 2022-12-09_06:26:13.013159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:14.545354 run osmo-stp_10.42.42.5(pid=2134): stderr: | 20221209062613203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062613203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062613204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062613204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062613204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062613204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062613205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:14.679481 run osmo-stp_10.42.42.5(pid=2134): stdout: | (launched: 2022-12-09_06:26:13.013159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:14.807790 run osmo-stp_10.42.42.5(pid=2134): stderr: | 20221209062613203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062613203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062613204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062613204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062613204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062613204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062613205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:14.959428 run patchelf(pid=2137): Terminating (SIGINT) 06:26:15.135154 run patchelf(pid=2137): Terminated: ok {rc=0} 06:26:15.261519 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2134): Process ended prematurely: osmo-stp_10.42.42.5(pid=2134) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2134)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 06:26:15.270834 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:26:15.298659 run osmo-hlr_10.42.42.2(pid=2131): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2131)] 06:26:15.348665 run osmo-hlr_10.42.42.2(pid=2131): stdout: | (launched: 2022-12-09_06:26:12.044102) 06:26:15.400183 run osmo-hlr_10.42.42.2(pid=2131): stderr: | 20221209062612240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062612240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062612240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062612240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062612240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062612240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062612254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062612262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062612262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062612262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:15.452061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2130): Terminating (SIGTERM) 06:26:15.493955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2133): Terminating (SIGTERM) 06:26:15.535672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2136): Terminating (SIGTERM) 06:26:15.577937 --- ParallelTerminationStrategy: PID 2130 died... 06:26:15.597843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2130): Terminated: ok {rc=0} 06:26:15.644050 --- ParallelTerminationStrategy: PID 2133 died... 06:26:15.663742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2133): Terminated: ok {rc=0} 06:26:15.709884 --- ParallelTerminationStrategy: PID 2136 died... 06:26:15.729782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2136): Terminated: ok {rc=0} 06:26:15.818572 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:26:17.148771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:26:17.155296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:26:17.188242 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:26:17.228588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:26:17.315729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:26:17.344886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:26:17.383720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:26:17.977216 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:26:18.025951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.036724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:18.102738 tst cs_paging_gprs_active.py: using LAC 19557 06:26:18.219503 tst cs_paging_gprs_active.py: using RAC 177 06:26:18.337218 tst cs_paging_gprs_active.py: using CellId 19557 06:26:18.454094 tst cs_paging_gprs_active.py: using BVCI 19558 06:26:18.571648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.583051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.594246 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.605818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.617252 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.628466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.639962 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.651149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:18.662572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:18.778282 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:18.896701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:26:19.111116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:19.428789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2141): Launched 06:26:19.703921 run iperf3-srv_10.42.42.10(pid=2142): Launched 06:26:19.823269 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:26:20.036487 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:20.354176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2143): Launched 06:26:20.629394 run iperf3-srv_10.42.42.10(pid=2144): Launched 06:26:20.749095 tst cs_paging_gprs_active.py:38: start network... 06:26:20.961856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:21.453165 run create_hlr_db(pid=2145): Launched 06:26:21.581932 bus /gobi_6: Setting Powered False 06:26:22.645256 run create_hlr_db(pid=2145): Terminated: ok {rc=0} 06:26:23.069406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2147): Launched 06:26:23.366855 run osmo-hlr_10.42.42.2(pid=2148): Launched 06:26:23.480316 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:24.003567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2150): Launched 06:26:24.300022 run osmo-stp_10.42.42.5(pid=2151): Launched 06:26:24.413248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:24.924146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2153): Launched 06:26:25.037829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:25.288255 run patchelf(pid=2154): Launched 06:26:25.452769 run osmo-stp_10.42.42.5(pid=2151): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2151)] 06:26:25.578858 run osmo-stp_10.42.42.5(pid=2151): stdout: | (launched: 2022-12-09_06:26:24.245924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:25.706540 run osmo-stp_10.42.42.5(pid=2151): stderr: | 20221209062624415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062624415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062624415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062624416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062624416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062624417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062624417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:25.833938 run osmo-stp_10.42.42.5(pid=2151): stdout: | (launched: 2022-12-09_06:26:24.245924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:25.955781 run osmo-stp_10.42.42.5(pid=2151): stderr: | 20221209062624415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062624415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062624415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062624416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062624416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062624417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062624417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:26.100224 run patchelf(pid=2154): Terminating (SIGINT) 06:26:26.267117 run patchelf(pid=2154): Terminated: ok {rc=0} 06:26:26.387567 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2151): Process ended prematurely: osmo-stp_10.42.42.5(pid=2151) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2151)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:26:26.396867 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:26:26.424231 run osmo-hlr_10.42.42.2(pid=2148): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2148)] 06:26:26.471850 run osmo-hlr_10.42.42.2(pid=2148): stdout: | (launched: 2022-12-09_06:26:23.311793) 06:26:26.521452 run osmo-hlr_10.42.42.2(pid=2148): stderr: | 20221209062623486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062623486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062623486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062623486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062623486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062623486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062623498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062623507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062623507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062623507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:26.571240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2141): Terminating (SIGTERM) 06:26:26.611393 run iperf3-srv_10.42.42.10(pid=2142): Terminating (SIGTERM) 06:26:26.651305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2143): Terminating (SIGTERM) 06:26:26.691279 run iperf3-srv_10.42.42.10(pid=2144): Terminating (SIGTERM) 06:26:26.730964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2147): Terminating (SIGTERM) 06:26:26.770781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2150): Terminating (SIGTERM) 06:26:26.810552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2153): Terminating (SIGTERM) 06:26:26.850708 --- ParallelTerminationStrategy: PID 2141 died... 06:26:26.869786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2141): Terminated: ok {rc=0} 06:26:26.914079 --- ParallelTerminationStrategy: PID 2142 died... 06:26:26.932354 run iperf3-srv_10.42.42.10(pid=2142): Terminated {rc=256} 06:26:26.976157 --- ParallelTerminationStrategy: PID 2143 died... 06:26:26.994607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2143): Terminated: ok {rc=0} 06:26:27.038317 --- ParallelTerminationStrategy: PID 2144 died... 06:26:27.056889 run iperf3-srv_10.42.42.10(pid=2144): Terminated {rc=256} 06:26:27.101626 --- ParallelTerminationStrategy: PID 2147 died... 06:26:27.120196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2147): Terminated: ok {rc=0} 06:26:27.164127 --- ParallelTerminationStrategy: PID 2150 died... 06:26:27.182619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2150): Terminated: ok {rc=0} 06:26:27.226594 --- ParallelTerminationStrategy: PID 2153 died... 06:26:27.245016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2153): Terminated: ok {rc=0} 06:26:27.330674 bus /gobi_0: Setting Powered False 06:26:28.428516 bus /gobi_0: Setting Powered False 06:26:29.542509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:26:30.686342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:30.697826 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:30.766156 tst iperf3.py: using LAC 19558 06:26:30.910264 tst iperf3.py: using RAC 178 06:26:31.057436 tst iperf3.py: using CellId 19558 06:26:31.184587 tst iperf3.py: using BVCI 19559 06:26:31.302536 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.314541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.326407 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.338328 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.350283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.362178 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.375264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.387156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:31.399164 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:31.516235 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:31.735549 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:32.063120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2155): Launched 06:26:32.340367 run iperf3-srv_10.42.42.10(pid=2156): Launched 06:26:32.451735 tst iperf3.py:8: start network... 06:26:32.649302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:33.105834 run create_hlr_db(pid=2157): Launched 06:26:33.218489 bus /gobi_6: Setting Powered False 06:26:34.277967 run create_hlr_db(pid=2157): Terminated: ok {rc=0} 06:26:34.709854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2159): Launched 06:26:35.025964 run osmo-hlr_10.42.42.2(pid=2160): Launched 06:26:35.146517 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:35.696300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2162): Launched 06:26:36.012106 run osmo-stp_10.42.42.5(pid=2163): Launched 06:26:36.132326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:36.677714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2165): Launched 06:26:36.799262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:37.067194 run patchelf(pid=2166): Launched 06:26:37.244201 run osmo-stp_10.42.42.5(pid=2163): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2163)] 06:26:37.378369 run osmo-stp_10.42.42.5(pid=2163): stdout: | (launched: 2022-12-09_06:26:35.954780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:37.513882 run osmo-stp_10.42.42.5(pid=2163): stderr: | 20221209062636146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062636146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062636146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062636147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062636147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062636147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062636147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:37.649677 run osmo-stp_10.42.42.5(pid=2163): stdout: | (launched: 2022-12-09_06:26:35.954780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:37.781167 run osmo-stp_10.42.42.5(pid=2163): stderr: | 20221209062636146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062636146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062636146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062636147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062636147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062636147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062636147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:37.935866 run patchelf(pid=2166): Terminating (SIGINT) 06:26:38.113674 run patchelf(pid=2166): Terminated: ok {rc=0} 06:26:38.241958 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2163): Process ended prematurely: osmo-stp_10.42.42.5(pid=2163) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2163)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 06:26:38.252069 tst iperf3.py:8: Test FAILED (7.6 sec) 06:26:38.280334 run osmo-hlr_10.42.42.2(pid=2160): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2160)] 06:26:38.330421 run osmo-hlr_10.42.42.2(pid=2160): stdout: | (launched: 2022-12-09_06:26:34.968567) 06:26:38.382134 run osmo-hlr_10.42.42.2(pid=2160): stderr: | 20221209062635165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062635165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062635165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062635165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062635165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062635165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062635179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062635188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062635189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062635189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:38.434055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2155): Terminating (SIGTERM) 06:26:38.475711 run iperf3-srv_10.42.42.10(pid=2156): Terminating (SIGTERM) 06:26:38.517558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2159): Terminating (SIGTERM) 06:26:38.559526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2162): Terminating (SIGTERM) 06:26:38.601441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2165): Terminating (SIGTERM) 06:26:38.643421 --- ParallelTerminationStrategy: PID 2155 died... 06:26:38.663346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2155): Terminated: ok {rc=0} 06:26:38.709916 --- ParallelTerminationStrategy: PID 2156 died... 06:26:38.729478 run iperf3-srv_10.42.42.10(pid=2156): Terminated {rc=256} 06:26:38.775702 --- ParallelTerminationStrategy: PID 2159 died... 06:26:38.795335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2159): Terminated: ok {rc=0} 06:26:38.841231 --- ParallelTerminationStrategy: PID 2162 died... 06:26:38.860579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2162): Terminated: ok {rc=0} 06:26:38.906649 --- ParallelTerminationStrategy: PID 2165 died... 06:26:38.926300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2165): Terminated: ok {rc=0} 06:26:39.012982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:26:40.161404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.173558 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:40.241609 tst iperf3m4.py: using LAC 19559 06:26:40.366572 tst iperf3m4.py: using RAC 179 06:26:40.491206 tst iperf3m4.py: using CellId 19559 06:26:40.618699 tst iperf3m4.py: using BVCI 19560 06:26:40.735040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.746981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.758461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.769985 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.781214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.792534 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.803916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.815158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:40.826509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:40.943907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:41.060294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:41.179720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:26:41.295783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:26:41.509535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:41.827028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2167): Launched 06:26:42.102638 run iperf3-srv_10.42.42.10(pid=2168): Launched 06:26:42.221444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:26:42.434496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:42.751939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Launched 06:26:43.027945 run iperf3-srv_10.42.42.10(pid=2170): Launched 06:26:43.146891 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:26:43.360050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:43.677233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Launched 06:26:43.953494 run iperf3-srv_10.42.42.10(pid=2172): Launched 06:26:44.072518 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:26:44.286186 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:26:44.604168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Launched 06:26:44.880018 run iperf3-srv_10.42.42.10(pid=2174): Launched 06:26:44.999143 tst iperf3m4.py:8: start network... 06:26:45.212624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:26:45.704847 run create_hlr_db(pid=2175): Launched 06:26:45.836807 bus /gobi_6: Setting Powered False 06:26:46.922091 run create_hlr_db(pid=2175): Terminated: ok {rc=0} 06:26:47.357414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Launched 06:26:47.652153 run osmo-hlr_10.42.42.2(pid=2178): Launched 06:26:47.764653 run osmo-stp_10.42.42.5: Starting osmo-stp 06:26:48.287312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Launched 06:26:48.583084 run osmo-stp_10.42.42.5(pid=2181): Launched 06:26:48.694903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:26:49.203724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2183): Launched 06:26:49.317985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:26:49.567726 run patchelf(pid=2184): Launched 06:26:49.731582 run osmo-stp_10.42.42.5(pid=2181): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] 06:26:49.857310 run osmo-stp_10.42.42.5(pid=2181): stdout: | (launched: 2022-12-09_06:26:48.528469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:49.983988 run osmo-stp_10.42.42.5(pid=2181): stderr: | 20221209062648695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062648695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062648696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062648696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062648697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062648697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062648697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:50.110996 run osmo-stp_10.42.42.5(pid=2181): stdout: | (launched: 2022-12-09_06:26:48.528469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:26:50.233732 run osmo-stp_10.42.42.5(pid=2181): stderr: | 20221209062648695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062648695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062648696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062648696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062648697 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062648697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062648697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:26:50.378623 run patchelf(pid=2184): Terminating (SIGINT) 06:26:50.545185 run patchelf(pid=2184): Terminated: ok {rc=0} 06:26:50.665913 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2181): Process ended prematurely: osmo-stp_10.42.42.5(pid=2181) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:26:50.675232 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:26:50.702527 run osmo-hlr_10.42.42.2(pid=2178): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2178)] 06:26:50.750224 run osmo-hlr_10.42.42.2(pid=2178): stdout: | (launched: 2022-12-09_06:26:47.598411) 06:26:50.800362 run osmo-hlr_10.42.42.2(pid=2178): stderr: | 20221209062647772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062647772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062647772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062647772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062647772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062647773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062647785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062647795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062647796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062647796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:26:50.849970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2167): Terminating (SIGTERM) 06:26:50.890118 run iperf3-srv_10.42.42.10(pid=2168): Terminating (SIGTERM) 06:26:50.929870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Terminating (SIGTERM) 06:26:50.969564 run iperf3-srv_10.42.42.10(pid=2170): Terminating (SIGTERM) 06:26:51.009432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminating (SIGTERM) 06:26:51.048929 run iperf3-srv_10.42.42.10(pid=2172): Terminating (SIGTERM) 06:26:51.088217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Terminating (SIGTERM) 06:26:51.127562 run iperf3-srv_10.42.42.10(pid=2174): Terminating (SIGTERM) 06:26:51.166933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminating (SIGTERM) 06:26:51.206344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Terminating (SIGTERM) 06:26:51.245848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2183): Terminating (SIGTERM) 06:26:51.285443 --- ParallelTerminationStrategy: PID 2167 died... 06:26:51.304619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2167): Terminated: ok {rc=0} 06:26:51.348753 --- ParallelTerminationStrategy: PID 2168 died... 06:26:51.367165 run iperf3-srv_10.42.42.10(pid=2168): Terminated {rc=256} 06:26:51.410725 --- ParallelTerminationStrategy: PID 2169 died... 06:26:51.429485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Terminated: ok {rc=0} 06:26:51.473402 --- ParallelTerminationStrategy: PID 2170 died... 06:26:51.491743 run iperf3-srv_10.42.42.10(pid=2170): Terminated {rc=256} 06:26:51.535690 --- ParallelTerminationStrategy: PID 2171 died... 06:26:51.554546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminated: ok {rc=0} 06:26:51.599370 --- ParallelTerminationStrategy: PID 2172 died... 06:26:51.617750 run iperf3-srv_10.42.42.10(pid=2172): Terminated {rc=256} 06:26:51.662136 --- ParallelTerminationStrategy: PID 2173 died... 06:26:51.680657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2173): Terminated: ok {rc=0} 06:26:51.725051 --- ParallelTerminationStrategy: PID 2174 died... 06:26:51.743608 run iperf3-srv_10.42.42.10(pid=2174): Terminated {rc=256} 06:26:51.787700 --- ParallelTerminationStrategy: PID 2177 died... 06:26:51.806247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2177): Terminated: ok {rc=0} 06:26:51.851000 --- ParallelTerminationStrategy: PID 2180 died... 06:26:51.869515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2180): Terminated: ok {rc=0} 06:26:51.913726 --- ParallelTerminationStrategy: PID 2183 died... 06:26:51.932409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2183): Terminated: ok {rc=0} 06:26:52.017685 bus /gobi_4: Setting Powered False 06:26:53.116169 bus /gobi_4: Setting Powered False 06:26:54.227779 bus /gobi_1: Setting Powered False 06:26:55.326097 bus /gobi_1: Setting Powered False 06:26:56.442748 bus /gobi_0: Setting Powered False 06:26:57.540358 bus /gobi_0: Setting Powered False 06:26:58.656396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:26:59.758338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:26:59.770268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:26:59.837543 tst ping.py: using LAC 19560 06:26:59.960229 tst ping.py: using RAC 180 06:27:00.081416 tst ping.py: using CellId 19560 06:27:00.202195 tst ping.py: using BVCI 19561 06:27:00.314117 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.325547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.336738 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.347981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.359172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.370402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.381682 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:00.392789 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:00.505450 tst ping.py:19: start network... 06:27:00.715714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:01.211753 run create_hlr_db(pid=2187): Launched 06:27:01.367128 bus /gobi_6: Setting Powered False 06:27:02.429986 run create_hlr_db(pid=2187): Terminated: ok {rc=0} 06:27:02.847573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2189): Launched 06:27:03.137421 run osmo-hlr_10.42.42.2(pid=2190): Launched 06:27:03.248207 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:03.750124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2192): Launched 06:27:04.039741 run osmo-stp_10.42.42.5(pid=2193): Launched 06:27:04.149550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:04.650552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2195): Launched 06:27:04.762629 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:05.007986 run patchelf(pid=2196): Launched 06:27:05.170837 run osmo-stp_10.42.42.5(pid=2193): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2193)] 06:27:05.294961 run osmo-stp_10.42.42.5(pid=2193): stdout: | (launched: 2022-12-09_06:27:03.986925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:05.421154 run osmo-stp_10.42.42.5(pid=2193): stderr: | 20221209062704156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062704156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062704157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062704157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062704158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062704158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062704158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:05.546912 run osmo-stp_10.42.42.5(pid=2193): stdout: | (launched: 2022-12-09_06:27:03.986925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:05.667014 run osmo-stp_10.42.42.5(pid=2193): stderr: | 20221209062704156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062704156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062704157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062704157 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062704158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062704158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062704158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:05.809384 run patchelf(pid=2196): Terminating (SIGINT) 06:27:05.973654 run patchelf(pid=2196): Terminated: ok {rc=0} 06:27:06.092214 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2193): Process ended prematurely: osmo-stp_10.42.42.5(pid=2193) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2193)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 06:27:06.100992 tst ping.py:22: Test FAILED (6.3 sec) 06:27:06.128018 run osmo-hlr_10.42.42.2(pid=2190): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2190)] 06:27:06.176598 run osmo-hlr_10.42.42.2(pid=2190): stdout: | (launched: 2022-12-09_06:27:03.084212) 06:27:06.226784 run osmo-hlr_10.42.42.2(pid=2190): stderr: | 20221209062703258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062703258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062703258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062703258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062703258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062703258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062703271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062703279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062703279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062703279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:06.277537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2189): Terminating (SIGTERM) 06:27:06.317836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2192): Terminating (SIGTERM) 06:27:06.357846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2195): Terminating (SIGTERM) 06:27:06.398637 --- ParallelTerminationStrategy: PID 2189 died... 06:27:06.417915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2189): Terminated: ok {rc=0} 06:27:06.462783 --- ParallelTerminationStrategy: PID 2192 died... 06:27:06.481645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2192): Terminated: ok {rc=0} 06:27:06.526289 --- ParallelTerminationStrategy: PID 2195 died... 06:27:06.545098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2195): Terminated: ok {rc=0} 06:27:06.631544 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:27:07.719539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:07.731655 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:27:07.799454 tst ping_idle_ping.py: using LAC 19561 06:27:07.924275 tst ping_idle_ping.py: using RAC 181 06:27:08.046633 tst ping_idle_ping.py: using CellId 19561 06:27:08.168738 tst ping_idle_ping.py: using BVCI 19562 06:27:08.281993 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.293493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.304669 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.315944 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.327070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.338374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.349774 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:27:08.360880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:27:08.478379 tst ping_idle_ping.py:24: start network... 06:27:08.688819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:09.175080 run create_hlr_db(pid=2197): Launched 06:27:09.301650 bus /gobi_6: Setting Powered False 06:27:10.364170 run create_hlr_db(pid=2197): Terminated: ok {rc=0} 06:27:10.782860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2199): Launched 06:27:11.073908 run osmo-hlr_10.42.42.2(pid=2200): Launched 06:27:11.185112 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:11.688033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2202): Launched 06:27:11.979857 run osmo-stp_10.42.42.5(pid=2203): Launched 06:27:12.090832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:12.594414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2205): Launched 06:27:12.705860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:12.951967 run patchelf(pid=2206): Launched 06:27:13.114611 run osmo-stp_10.42.42.5(pid=2203): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2203)] 06:27:13.238848 run osmo-stp_10.42.42.5(pid=2203): stdout: | (launched: 2022-12-09_06:27:11.926553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:13.364356 run osmo-stp_10.42.42.5(pid=2203): stderr: | 20221209062712094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062712094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062712094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062712095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062712095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062712095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062712095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:13.490127 run osmo-stp_10.42.42.5(pid=2203): stdout: | (launched: 2022-12-09_06:27:11.926553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:13.610029 run osmo-stp_10.42.42.5(pid=2203): stderr: | 20221209062712094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062712094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062712094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062712095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062712095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062712095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062712095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:13.751853 run patchelf(pid=2206): Terminating (SIGINT) 06:27:13.916630 run patchelf(pid=2206): Terminated: ok {rc=0} 06:27:14.035025 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2203): Process ended prematurely: osmo-stp_10.42.42.5(pid=2203) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2203)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:27:14.043733 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:27:14.070529 run osmo-hlr_10.42.42.2(pid=2200): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2200)] 06:27:14.118484 run osmo-hlr_10.42.42.2(pid=2200): stdout: | (launched: 2022-12-09_06:27:11.020607) 06:27:14.167866 run osmo-hlr_10.42.42.2(pid=2200): stderr: | 20221209062711193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062711193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062711193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062711193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062711193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062711193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062711205 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062711215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062711215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062711215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:14.217912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2199): Terminating (SIGTERM) 06:27:14.257849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2202): Terminating (SIGTERM) 06:27:14.297528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2205): Terminating (SIGTERM) 06:27:14.337906 --- ParallelTerminationStrategy: PID 2199 died... 06:27:14.356801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2199): Terminated: ok {rc=0} 06:27:14.401328 --- ParallelTerminationStrategy: PID 2202 died... 06:27:14.419664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2202): Terminated: ok {rc=0} 06:27:14.463622 --- ParallelTerminationStrategy: PID 2205 died... 06:27:14.482506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2205): Terminated: ok {rc=0} 06:27:14.568313 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:27:15.875646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:27:15.882247 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:27:15.916711 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 06:27:15.956439 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 06:27:16.040024 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:27:16.070295 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 06:27:16.109538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 06:27:16.749100 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 06:27:16.821883 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:16.834271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:16.900863 tst cs_paging_gprs_active.py: using LAC 19562 06:27:17.059267 tst cs_paging_gprs_active.py: using RAC 182 06:27:17.178617 tst cs_paging_gprs_active.py: using CellId 19562 06:27:17.304733 tst cs_paging_gprs_active.py: using BVCI 19563 06:27:17.421477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.433033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.444321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.456263 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.468040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.479803 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.492789 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.504829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:17.517016 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:17.634601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:17.749039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:27:17.947974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:18.245129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2210): Launched 06:27:18.503012 run iperf3-srv_10.42.42.10(pid=2211): Launched 06:27:18.614174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:27:18.811266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:19.107357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2212): Launched 06:27:19.364539 run iperf3-srv_10.42.42.10(pid=2213): Launched 06:27:19.475099 tst cs_paging_gprs_active.py:38: start network... 06:27:19.672417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:20.131303 run create_hlr_db(pid=2214): Launched 06:27:20.243489 bus /gobi_6: Setting Powered False 06:27:21.302847 run create_hlr_db(pid=2214): Terminated: ok {rc=0} 06:27:21.716708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Launched 06:27:22.013780 run osmo-hlr_10.42.42.2(pid=2217): Launched 06:27:22.127023 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:22.633969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Launched 06:27:22.929200 run osmo-stp_10.42.42.5(pid=2220): Launched 06:27:23.042656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:23.554280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2222): Launched 06:27:23.667904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:23.922984 run patchelf(pid=2223): Launched 06:27:24.088403 run osmo-stp_10.42.42.5(pid=2220): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] 06:27:24.215150 run osmo-stp_10.42.42.5(pid=2220): stdout: | (launched: 2022-12-09_06:27:22.874879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:24.343085 run osmo-stp_10.42.42.5(pid=2220): stderr: | 20221209062723044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062723044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062723044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062723045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062723045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062723045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062723046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:24.471391 run osmo-stp_10.42.42.5(pid=2220): stdout: | (launched: 2022-12-09_06:27:22.874879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:24.594058 run osmo-stp_10.42.42.5(pid=2220): stderr: | 20221209062723044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062723044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062723044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062723045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062723045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062723045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062723046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:24.739260 run patchelf(pid=2223): Terminating (SIGINT) 06:27:24.907059 run patchelf(pid=2223): Terminated: ok {rc=0} 06:27:25.028413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2220): Process ended prematurely: osmo-stp_10.42.42.5(pid=2220) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 06:27:25.037959 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 06:27:25.065682 run osmo-hlr_10.42.42.2(pid=2217): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2217)] 06:27:25.114448 run osmo-hlr_10.42.42.2(pid=2217): stdout: | (launched: 2022-12-09_06:27:21.959416) 06:27:25.164414 run osmo-hlr_10.42.42.2(pid=2217): stderr: | 20221209062722135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062722135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062722135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062722135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062722135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062722136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062722151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062722161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062722161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062722161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:25.214727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2210): Terminating (SIGTERM) 06:27:25.254876 run iperf3-srv_10.42.42.10(pid=2211): Terminating (SIGTERM) 06:27:25.295229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2212): Terminating (SIGTERM) 06:27:25.335923 run iperf3-srv_10.42.42.10(pid=2213): Terminating (SIGTERM) 06:27:25.376136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Terminating (SIGTERM) 06:27:25.416383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Terminating (SIGTERM) 06:27:25.456808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2222): Terminating (SIGTERM) 06:27:25.498326 --- ParallelTerminationStrategy: PID 2210 died... 06:27:25.517471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2210): Terminated: ok {rc=0} 06:27:25.562562 --- ParallelTerminationStrategy: PID 2211 died... 06:27:25.581166 run iperf3-srv_10.42.42.10(pid=2211): Terminated {rc=256} 06:27:25.625837 --- ParallelTerminationStrategy: PID 2212 died... 06:27:25.644548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2212): Terminated: ok {rc=0} 06:27:25.688818 --- ParallelTerminationStrategy: PID 2213 died... 06:27:25.707896 run iperf3-srv_10.42.42.10(pid=2213): Terminated {rc=256} 06:27:25.752250 --- ParallelTerminationStrategy: PID 2216 died... 06:27:25.771399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2216): Terminated: ok {rc=0} 06:27:25.815803 --- ParallelTerminationStrategy: PID 2219 died... 06:27:25.834507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2219): Terminated: ok {rc=0} 06:27:25.878761 --- ParallelTerminationStrategy: PID 2222 died... 06:27:25.897336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2222): Terminated: ok {rc=0} 06:27:25.983761 bus /gobi_0: Setting Powered False 06:27:27.082517 bus /gobi_0: Setting Powered False 06:27:28.198613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 06:27:29.343285 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.354849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:29.421681 tst iperf3.py: using LAC 19563 06:27:29.546553 tst iperf3.py: using RAC 183 06:27:29.676182 tst iperf3.py: using CellId 19563 06:27:29.800906 tst iperf3.py: using BVCI 19564 06:27:29.916273 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.927880 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.939308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.951040 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.962520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.973977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.985533 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:29.996697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:30.008317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:30.125716 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:27:30.339052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:30.656206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2224): Launched 06:27:30.953999 run iperf3-srv_10.42.42.10(pid=2225): Launched 06:27:31.114924 tst iperf3.py:8: start network... 06:27:31.352676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:31.915056 run create_hlr_db(pid=2226): Launched 06:27:32.071944 bus /gobi_6: Setting Powered False 06:27:33.135487 run create_hlr_db(pid=2226): Terminated: ok {rc=0} 06:27:33.558222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2228): Launched 06:27:33.854063 run osmo-hlr_10.42.42.2(pid=2229): Launched 06:27:33.966464 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:34.487897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2231): Launched 06:27:34.783905 run osmo-stp_10.42.42.5(pid=2232): Launched 06:27:34.896461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:35.405079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2234): Launched 06:27:35.517718 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:35.768378 run patchelf(pid=2236): Launched 06:27:35.937122 run osmo-stp_10.42.42.5(pid=2232): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2232)] 06:27:36.062827 run osmo-stp_10.42.42.5(pid=2232): stdout: | (launched: 2022-12-09_06:27:34.729861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:36.190490 run osmo-stp_10.42.42.5(pid=2232): stderr: | 20221209062734897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062734897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062734898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062734898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062734898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062734898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062734898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:36.318137 run osmo-stp_10.42.42.5(pid=2232): stdout: | (launched: 2022-12-09_06:27:34.729861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:36.440683 run osmo-stp_10.42.42.5(pid=2232): stderr: | 20221209062734897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062734897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062734898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062734898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062734898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062734898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062734898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:36.585572 run patchelf(pid=2236): Terminating (SIGINT) 06:27:36.752175 run patchelf(pid=2236): Terminated: ok {rc=0} 06:27:36.872545 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2232): Process ended prematurely: osmo-stp_10.42.42.5(pid=2232) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2232)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 06:27:36.882500 tst iperf3.py:8: Test FAILED (7.6 sec) 06:27:36.909973 run osmo-hlr_10.42.42.2(pid=2229): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2229)] 06:27:36.958752 run osmo-hlr_10.42.42.2(pid=2229): stdout: | (launched: 2022-12-09_06:27:33.800034) 06:27:37.009195 run osmo-hlr_10.42.42.2(pid=2229): stderr: | 20221209062733974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062733974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062733974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062733974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062733974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062733975 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062733986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062733996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062733996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062733996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:37.059854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2224): Terminating (SIGTERM) 06:27:37.100431 run iperf3-srv_10.42.42.10(pid=2225): Terminating (SIGTERM) 06:27:37.140893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2228): Terminating (SIGTERM) 06:27:37.181412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2231): Terminating (SIGTERM) 06:27:37.222002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2234): Terminating (SIGTERM) 06:27:37.263013 --- ParallelTerminationStrategy: PID 2224 died... 06:27:37.282348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2224): Terminated: ok {rc=0} 06:27:37.327837 --- ParallelTerminationStrategy: PID 2225 died... 06:27:37.346885 run iperf3-srv_10.42.42.10(pid=2225): Terminated {rc=256} 06:27:37.392126 --- ParallelTerminationStrategy: PID 2228 died... 06:27:37.411105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2228): Terminated: ok {rc=0} 06:27:37.456399 --- ParallelTerminationStrategy: PID 2231 died... 06:27:37.475388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2231): Terminated: ok {rc=0} 06:27:37.520423 --- ParallelTerminationStrategy: PID 2234 died... 06:27:37.539477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2234): Terminated: ok {rc=0} 06:27:37.627519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 06:27:38.775046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:38.786783 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:38.853294 tst iperf3m4.py: using LAC 19564 06:27:38.974394 tst iperf3m4.py: using RAC 184 06:27:39.091683 tst iperf3m4.py: using CellId 19564 06:27:39.206840 tst iperf3m4.py: using BVCI 19565 06:27:39.314915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.326274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.337402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.348200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.359828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.370752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.382506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.393508 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:39.405114 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:39.520180 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:39.641805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:39.757752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:39.873808 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:27:40.071583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:40.368514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2237): Launched 06:27:40.627421 run iperf3-srv_10.42.42.10(pid=2238): Launched 06:27:40.738884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:27:40.936311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:41.232851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2239): Launched 06:27:41.490670 run iperf3-srv_10.42.42.10(pid=2240): Launched 06:27:41.601887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:27:41.799966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:42.097209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2241): Launched 06:27:42.355839 run iperf3-srv_10.42.42.10(pid=2242): Launched 06:27:42.467017 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:27:42.664510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:27:42.961058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2243): Launched 06:27:43.218677 run iperf3-srv_10.42.42.10(pid=2244): Launched 06:27:43.330065 tst iperf3m4.py:8: start network... 06:27:43.527676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:43.985942 run create_hlr_db(pid=2245): Launched 06:27:44.097987 bus /gobi_6: Setting Powered False 06:27:45.157571 run create_hlr_db(pid=2245): Terminated: ok {rc=0} 06:27:45.569997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2247): Launched 06:27:45.880602 run osmo-hlr_10.42.42.2(pid=2248): Launched 06:27:46.110072 run osmo-stp_10.42.42.5: Starting osmo-stp 06:27:46.688098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2250): Launched 06:27:47.013906 run osmo-stp_10.42.42.5(pid=2251): Launched 06:27:47.224992 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:27:47.803818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2253): Launched 06:27:47.917291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:27:48.168384 run patchelf(pid=2254): Launched 06:27:48.333647 run osmo-stp_10.42.42.5(pid=2251): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2251)] 06:27:48.459699 run osmo-stp_10.42.42.5(pid=2251): stdout: | (launched: 2022-12-09_06:27:46.946111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:48.587102 run osmo-stp_10.42.42.5(pid=2251): stderr: | 20221209062747277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062747277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062747278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062747278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062747278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062747279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062747279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:48.714425 run osmo-stp_10.42.42.5(pid=2251): stdout: | (launched: 2022-12-09_06:27:46.946111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:27:48.837250 run osmo-stp_10.42.42.5(pid=2251): stderr: | 20221209062747277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062747277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062747278 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062747278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062747278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062747279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062747279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:27:48.982391 run patchelf(pid=2254): Terminating (SIGINT) 06:27:49.149543 run patchelf(pid=2254): Terminated: ok {rc=0} 06:27:49.270266 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2251): Process ended prematurely: osmo-stp_10.42.42.5(pid=2251) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2251)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 06:27:49.279852 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:27:49.308397 run osmo-hlr_10.42.42.2(pid=2248): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2248)] 06:27:49.356691 run osmo-hlr_10.42.42.2(pid=2248): stdout: | (launched: 2022-12-09_06:27:45.811498) 06:27:49.406735 run osmo-hlr_10.42.42.2(pid=2248): stderr: | 20221209062746026 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062746026 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062746026 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062746026 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062746026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062746026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062746043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062746059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062746060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062746060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:27:49.457188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2237): Terminating (SIGTERM) 06:27:49.497708 run iperf3-srv_10.42.42.10(pid=2238): Terminating (SIGTERM) 06:27:49.538176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2239): Terminating (SIGTERM) 06:27:49.578820 run iperf3-srv_10.42.42.10(pid=2240): Terminating (SIGTERM) 06:27:49.619253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2241): Terminating (SIGTERM) 06:27:49.659760 run iperf3-srv_10.42.42.10(pid=2242): Terminating (SIGTERM) 06:27:49.700535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2243): Terminating (SIGTERM) 06:27:49.741205 run iperf3-srv_10.42.42.10(pid=2244): Terminating (SIGTERM) 06:27:49.781789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2247): Terminating (SIGTERM) 06:27:49.822370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2250): Terminating (SIGTERM) 06:27:49.862787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2253): Terminating (SIGTERM) 06:27:49.902927 --- ParallelTerminationStrategy: PID 2237 died... 06:27:49.921963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2237): Terminated: ok {rc=0} 06:27:49.966839 --- ParallelTerminationStrategy: PID 2238 died... 06:27:49.985390 run iperf3-srv_10.42.42.10(pid=2238): Terminated {rc=256} 06:27:50.029623 --- ParallelTerminationStrategy: PID 2239 died... 06:27:50.048229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2239): Terminated: ok {rc=0} 06:27:50.092531 --- ParallelTerminationStrategy: PID 2240 died... 06:27:50.111214 run iperf3-srv_10.42.42.10(pid=2240): Terminated {rc=256} 06:27:50.155639 --- ParallelTerminationStrategy: PID 2241 died... 06:27:50.174408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2241): Terminated: ok {rc=0} 06:27:50.219051 --- ParallelTerminationStrategy: PID 2242 died... 06:27:50.237704 run iperf3-srv_10.42.42.10(pid=2242): Terminated {rc=256} 06:27:50.282449 --- ParallelTerminationStrategy: PID 2243 died... 06:27:50.301137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2243): Terminated: ok {rc=0} 06:27:50.345547 --- ParallelTerminationStrategy: PID 2244 died... 06:27:50.364232 run iperf3-srv_10.42.42.10(pid=2244): Terminated {rc=256} 06:27:50.408428 --- ParallelTerminationStrategy: PID 2247 died... 06:27:50.426946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2247): Terminated: ok {rc=0} 06:27:50.471148 --- ParallelTerminationStrategy: PID 2250 died... 06:27:50.489799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2250): Terminated: ok {rc=0} 06:27:50.533948 --- ParallelTerminationStrategy: PID 2253 died... 06:27:50.552609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2253): Terminated: ok {rc=0} 06:27:50.638676 bus /gobi_4: Setting Powered False 06:27:51.737779 bus /gobi_4: Setting Powered False 06:27:52.851335 bus /gobi_1: Setting Powered False 06:27:53.949422 bus /gobi_1: Setting Powered False 06:27:55.065480 bus /gobi_0: Setting Powered False 06:27:56.164725 bus /gobi_0: Setting Powered False 06:27:57.281250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 06:27:58.383001 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.395239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:27:58.464250 tst ping.py: using LAC 19565 06:27:58.579660 tst ping.py: using RAC 185 06:27:58.703557 tst ping.py: using CellId 19565 06:27:58.826028 tst ping.py: using BVCI 19566 06:27:58.940028 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.951729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.963226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.974504 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.985731 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:58.997032 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:59.008371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:27:59.019610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:27:59.132754 tst ping.py:19: start network... 06:27:59.326516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:27:59.774759 run create_hlr_db(pid=2255): Launched 06:27:59.885377 bus /gobi_6: Setting Powered False 06:28:00.944317 run create_hlr_db(pid=2255): Terminated: ok {rc=0} 06:28:01.374233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2257): Launched 06:28:01.685742 run osmo-hlr_10.42.42.2(pid=2258): Launched 06:28:01.920755 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:02.586654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2260): Launched 06:28:02.898426 run osmo-stp_10.42.42.5(pid=2261): Launched 06:28:03.015988 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:03.557645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2263): Launched 06:28:03.677009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:03.941221 run patchelf(pid=2264): Launched 06:28:04.115387 run osmo-stp_10.42.42.5(pid=2261): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2261)] 06:28:04.248040 run osmo-stp_10.42.42.5(pid=2261): stdout: | (launched: 2022-12-09_06:28:02.841692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:04.382318 run osmo-stp_10.42.42.5(pid=2261): stderr: | 20221209062803032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062803032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062803032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062803033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062803035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062803035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062803035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:04.516426 run osmo-stp_10.42.42.5(pid=2261): stdout: | (launched: 2022-12-09_06:28:02.841692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:04.644437 run osmo-stp_10.42.42.5(pid=2261): stderr: | 20221209062803032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062803032 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062803032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062803033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062803035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062803035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062803035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:04.796434 run patchelf(pid=2264): Terminating (SIGINT) 06:28:04.971467 run patchelf(pid=2264): Terminated: ok {rc=0} 06:28:05.097952 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2261): Process ended prematurely: osmo-stp_10.42.42.5(pid=2261) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2261)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 06:28:05.107227 tst ping.py:22: Test FAILED (6.7 sec) 06:28:05.135265 run osmo-hlr_10.42.42.2(pid=2258): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2258)] 06:28:05.185360 run osmo-hlr_10.42.42.2(pid=2258): stdout: | (launched: 2022-12-09_06:28:01.619538) 06:28:05.237283 run osmo-hlr_10.42.42.2(pid=2258): stderr: | 20221209062801891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062801891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062801891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062801891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062801891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062801891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062801909 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062801933 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062801933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062801933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:05.289040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2257): Terminating (SIGTERM) 06:28:05.331035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2260): Terminating (SIGTERM) 06:28:05.373040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2263): Terminating (SIGTERM) 06:28:05.415223 --- ParallelTerminationStrategy: PID 2257 died... 06:28:05.435306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2257): Terminated: ok {rc=0} 06:28:05.481744 --- ParallelTerminationStrategy: PID 2260 died... 06:28:05.501415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2260): Terminated: ok {rc=0} 06:28:05.547544 --- ParallelTerminationStrategy: PID 2263 died... 06:28:05.567406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2263): Terminated: ok {rc=0} 06:28:05.655061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 06:28:06.742013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:06.754293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:28:06.827208 tst ping_idle_ping.py: using LAC 19566 06:28:06.949535 tst ping_idle_ping.py: using RAC 186 06:28:07.065137 tst ping_idle_ping.py: using CellId 19566 06:28:07.178334 tst ping_idle_ping.py: using BVCI 19567 06:28:07.285823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.296995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.307992 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.319153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.330121 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.341103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.352381 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 06:28:07.363342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 06:28:07.479840 tst ping_idle_ping.py:24: start network... 06:28:07.691038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:08.176806 run create_hlr_db(pid=2265): Launched 06:28:08.303619 bus /gobi_6: Setting Powered False 06:28:09.365845 run create_hlr_db(pid=2265): Terminated: ok {rc=0} 06:28:09.784044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2267): Launched 06:28:10.075237 run osmo-hlr_10.42.42.2(pid=2268): Launched 06:28:10.185824 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:10.697465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2270): Launched 06:28:10.987505 run osmo-stp_10.42.42.5(pid=2271): Launched 06:28:11.096903 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:11.599283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2273): Launched 06:28:11.711004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:11.957707 run patchelf(pid=2274): Launched 06:28:12.120858 run osmo-stp_10.42.42.5(pid=2271): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2271)] 06:28:12.244736 run osmo-stp_10.42.42.5(pid=2271): stdout: | (launched: 2022-12-09_06:28:10.934420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:12.369794 run osmo-stp_10.42.42.5(pid=2271): stderr: | 20221209062811104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062811104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062811105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062811105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062811105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062811105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062811106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:12.495448 run osmo-stp_10.42.42.5(pid=2271): stdout: | (launched: 2022-12-09_06:28:10.934420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:12.615281 run osmo-stp_10.42.42.5(pid=2271): stderr: | 20221209062811104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062811104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062811105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062811105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062811105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062811105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062811106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:12.756920 run patchelf(pid=2274): Terminating (SIGINT) 06:28:12.921243 run patchelf(pid=2274): Terminated: ok {rc=0} 06:28:13.039669 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2271): Process ended prematurely: osmo-stp_10.42.42.5(pid=2271) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2271)] [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 06:28:13.048472 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 06:28:13.075528 run osmo-hlr_10.42.42.2(pid=2268): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2268)] 06:28:13.124069 run osmo-hlr_10.42.42.2(pid=2268): stdout: | (launched: 2022-12-09_06:28:10.021930) 06:28:13.173847 run osmo-hlr_10.42.42.2(pid=2268): stderr: | 20221209062810198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062810198 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062810198 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062810198 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062810198 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062810198 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062810211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062810222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062810222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062810222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:13.224134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2267): Terminating (SIGTERM) 06:28:13.264320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2270): Terminating (SIGTERM) 06:28:13.304665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2273): Terminating (SIGTERM) 06:28:13.345121 --- ParallelTerminationStrategy: PID 2267 died... 06:28:13.364241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2267): Terminated: ok {rc=0} 06:28:13.409084 --- ParallelTerminationStrategy: PID 2270 died... 06:28:13.427784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2270): Terminated: ok {rc=0} 06:28:13.472116 --- ParallelTerminationStrategy: PID 2273 died... 06:28:13.490901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2273): Terminated: ok {rc=0} 06:28:13.577571 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:28:14.876725 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:14.883250 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:28:14.912708 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:28:14.946783 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:28:14.998336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:28:15.027161 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:28:15.061136 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:28:15.620443 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:28:15.625824 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:15.637151 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:28:15.702541 tst switch_tch_pdch.py: using LAC 19567 06:28:15.817422 tst switch_tch_pdch.py: using RAC 187 06:28:15.959619 tst switch_tch_pdch.py: using CellId 19567 06:28:16.103136 tst switch_tch_pdch.py: using BVCI 19568 06:28:16.221641 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.234268 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.246725 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.259302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.271862 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.284280 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.297703 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:28:16.310346 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:28:16.434048 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:28:16.586947 tst switch_tch_pdch.py:51: start network... 06:28:16.818402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:17.292396 run create_hlr_db(pid=2278): Launched 06:28:17.420507 bus /gobi_6: Setting Powered False 06:28:18.482552 run create_hlr_db(pid=2278): Terminated: ok {rc=0} 06:28:18.917648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Launched 06:28:19.228829 run osmo-hlr_10.42.42.2(pid=2281): Launched 06:28:19.346521 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:19.881096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Launched 06:28:20.192549 run osmo-stp_10.42.42.5(pid=2284): Launched 06:28:20.309826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:20.846170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2286): Launched 06:28:20.965220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:21.227821 run patchelf(pid=2287): Launched 06:28:21.401619 run osmo-stp_10.42.42.5(pid=2284): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2284)] 06:28:21.534901 run osmo-stp_10.42.42.5(pid=2284): stdout: | (launched: 2022-12-09_06:28:20.136073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:21.669499 run osmo-stp_10.42.42.5(pid=2284): stderr: | 20221209062820327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062820327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062820327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062820328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062820328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062820328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062820328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:21.804313 run osmo-stp_10.42.42.5(pid=2284): stdout: | (launched: 2022-12-09_06:28:20.136073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:21.932701 run osmo-stp_10.42.42.5(pid=2284): stderr: | 20221209062820327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062820327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062820327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062820328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062820328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062820328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062820328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:22.085364 run patchelf(pid=2287): Terminating (SIGINT) 06:28:22.260784 run patchelf(pid=2287): Terminated: ok {rc=0} 06:28:22.386536 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2284): Process ended prematurely: osmo-stp_10.42.42.5(pid=2284) [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2284)] [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:28:22.395882 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:28:22.423637 run osmo-hlr_10.42.42.2(pid=2281): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2281)] 06:28:22.473413 run osmo-hlr_10.42.42.2(pid=2281): stdout: | (launched: 2022-12-09_06:28:19.172376) 06:28:22.525279 run osmo-hlr_10.42.42.2(pid=2281): stderr: | 20221209062819371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062819371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062819371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062819371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062819371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062819371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062819384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062819393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062819394 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062819394 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:22.577326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Terminating (SIGTERM) 06:28:22.618990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Terminating (SIGTERM) 06:28:22.661030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2286): Terminating (SIGTERM) 06:28:22.703193 --- ParallelTerminationStrategy: PID 2280 died... 06:28:22.723279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2280): Terminated: ok {rc=0} 06:28:22.770011 --- ParallelTerminationStrategy: PID 2283 died... 06:28:22.789669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2283): Terminated: ok {rc=0} 06:28:22.835919 --- ParallelTerminationStrategy: PID 2286 died... 06:28:22.855675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2286): Terminated: ok {rc=0} 06:28:22.942823 bus /gobi_0: Setting Powered False 06:28:24.041090 bus /gobi_0: Setting Powered False 06:28:25.158796 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 06:28:26.413775 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:26.419814 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 06:28:26.449297 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 06:28:26.484213 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 06:28:26.538813 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 06:28:26.568018 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 06:28:26.602925 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 06:28:27.161242 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 06:28:27.166345 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.177776 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 06:28:27.244022 tst switch_tch_pdch.py: using LAC 19568 06:28:27.365341 tst switch_tch_pdch.py: using RAC 188 06:28:27.487270 tst switch_tch_pdch.py: using CellId 19568 06:28:27.609155 tst switch_tch_pdch.py: using BVCI 19569 06:28:27.721470 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.732784 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.744100 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.755347 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.766569 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.777901 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.789341 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 06:28:27.800832 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:28:27.918535 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 06:28:28.036593 tst switch_tch_pdch.py:51: start network... 06:28:28.246764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:28.700258 run create_hlr_db(pid=2291): Launched 06:28:28.817068 bus /gobi_6: Setting Powered False 06:28:29.875370 run create_hlr_db(pid=2291): Terminated: ok {rc=0} 06:28:30.257978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2293): Launched 06:28:30.546485 run osmo-hlr_10.42.42.2(pid=2294): Launched 06:28:30.658367 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:31.249323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2296): Launched 06:28:31.576238 run osmo-stp_10.42.42.5(pid=2297): Launched 06:28:31.753319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:28:32.394887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2299): Launched 06:28:32.514217 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:28:32.775626 run patchelf(pid=2300): Launched 06:28:32.949107 run osmo-stp_10.42.42.5(pid=2297): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2297)] 06:28:33.081607 run osmo-stp_10.42.42.5(pid=2297): stdout: | (launched: 2022-12-09_06:28:31.511391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:33.216481 run osmo-stp_10.42.42.5(pid=2297): stderr: | 20221209062831834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062831834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062831834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062831835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062831835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062831835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062831835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:33.350836 run osmo-stp_10.42.42.5(pid=2297): stdout: | (launched: 2022-12-09_06:28:31.511391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:33.478630 run osmo-stp_10.42.42.5(pid=2297): stderr: | 20221209062831834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062831834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062831834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062831835 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062831835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062831835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062831835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:33.630326 run patchelf(pid=2300): Terminating (SIGINT) 06:28:33.805739 run patchelf(pid=2300): Terminated: ok {rc=0} 06:28:33.931844 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2297): Process ended prematurely: osmo-stp_10.42.42.5(pid=2297) [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2297)] [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 06:28:33.941248 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:28:33.968764 run osmo-hlr_10.42.42.2(pid=2294): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2294)] 06:28:34.018458 run osmo-hlr_10.42.42.2(pid=2294): stdout: | (launched: 2022-12-09_06:28:30.493830) 06:28:34.069858 run osmo-hlr_10.42.42.2(pid=2294): stderr: | 20221209062830669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062830669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062830669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062830669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062830669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062830669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062830681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062830690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062830690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062830690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:34.122228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2293): Terminating (SIGTERM) 06:28:34.163946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2296): Terminating (SIGTERM) 06:28:34.205840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2299): Terminating (SIGTERM) 06:28:34.248062 --- ParallelTerminationStrategy: PID 2293 died... 06:28:34.268063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2293): Terminated: ok {rc=0} 06:28:34.314044 --- ParallelTerminationStrategy: PID 2296 died... 06:28:34.333670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2296): Terminated: ok {rc=0} 06:28:34.379758 --- ParallelTerminationStrategy: PID 2299 died... 06:28:34.399285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2299): Terminated: ok {rc=0} 06:28:34.486412 bus /gobi_0: Setting Powered False 06:28:35.586267 bus /gobi_0: Setting Powered False 06:28:36.705198 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_sms:nanobts --------------------------------------------------------------------- 06:28:37.947436 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:37.951277 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 06:28:37.975209 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 06:28:37.982292 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 06:28:38.034365 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 06:28:38.058815 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 06:28:38.065667 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 06:28:38.600448 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 06:28:38.605597 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 06:28:38.616060 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 06:28:38.653088 tst mo_mt_sms.py: using LAC 19569 06:28:38.766755 tst mo_mt_sms.py: using RAC 189 06:28:38.880863 tst mo_mt_sms.py: using CellId 19569 06:28:38.993630 tst mo_mt_sms.py: using BVCI 19570 06:28:39.108834 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:28:39.220048 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 06:28:39.331989 tst mo_mt_sms.py:9: start nitb and bts... 06:28:39.524657 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:28:40.116454 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2305): Launched 06:28:40.408491 run osmo-nitb_10.42.42.2(pid=2309): Launched 06:28:40.569137 run osmo-nitb_10.42.42.2(pid=2309): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2309)] 06:28:40.700632 run osmo-nitb_10.42.42.2(pid=2309): stdout: | (launched: 2022-12-09_06:28:40.355713) 06:28:40.834152 run osmo-nitb_10.42.42.2(pid=2309): stderr: | (launched: 2022-12-09_06:28:40.398816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:40.967402 run osmo-nitb_10.42.42.2(pid=2309): stdout: | (launched: 2022-12-09_06:28:40.355713) 06:28:41.094564 run osmo-nitb_10.42.42.2(pid=2309): stderr: | (launched: 2022-12-09_06:28:40.398816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2309) [trial-2355↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2309)] 06:28:41.517664 tst osmo-nitb_10.42.42.2(pid=2309): stdout: | (launched: 2022-12-09_06:28:40.355713) 06:28:41.636423 tst osmo-nitb_10.42.42.2(pid=2309): stderr: | (launched: 2022-12-09_06:28:40.398816) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:41.775431 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2309) [trial-2355↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2309)] [trial-2355↪nitb_sms:nanobts↪mo_mt_sms.py:11] 06:28:41.783957 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 06:28:41.790615 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2305): Terminating (SIGTERM) 06:28:42.001638 --- ParallelTerminationStrategy: PID 2305 died... 06:28:42.022701 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2305): Terminated: ok {rc=0} 06:28:42.109753 bus /sierra_3: Setting Powered False 06:28:43.208712 bus /sierra_3: Setting Powered False 06:28:44.324596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:nanobts+band-1900 --------------------------------------------------------------------- 06:28:45.506070 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:45.512352 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:28:45.536782 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:28:45.564163 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 06:28:45.618033 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:28:45.642901 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:28:45.670255 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 06:28:46.211838 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 06:28:46.217490 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.230578 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:28:46.267937 tst mo_mt_sms.py: using LAC 19570 06:28:46.384934 tst mo_mt_sms.py: using RAC 190 06:28:46.512671 tst mo_mt_sms.py: using CellId 19570 06:28:46.629626 tst mo_mt_sms.py: using BVCI 19571 06:28:46.769906 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.782361 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.794596 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.806373 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.818541 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:28:46.830259 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:28:46.952537 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 06:28:47.102199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:28:47.603633 run create_hlr_db(pid=2313): Launched 06:28:47.729696 bus /sierra_2: Setting Powered False 06:28:48.792034 run create_hlr_db(pid=2313): Terminated: ok {rc=0} 06:28:49.226647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2315): Launched 06:28:49.536928 run osmo-hlr_10.42.42.2(pid=2316): Launched 06:28:49.654315 run osmo-stp_10.42.42.5: Starting osmo-stp 06:28:50.193923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2318): Launched 06:28:50.503396 run osmo-stp_10.42.42.5(pid=2319): Launched 06:28:50.620300 run osmo-msc_10.42.42.6: Starting osmo-msc 06:28:51.182007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2321): Launched 06:28:51.493056 run osmo-msc_10.42.42.6(pid=2322): Launched 06:28:51.666927 run osmo-stp_10.42.42.5(pid=2319): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2319)] 06:28:51.798790 run osmo-stp_10.42.42.5(pid=2319): stdout: | (launched: 2022-12-09_06:28:50.447164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:51.932026 run osmo-stp_10.42.42.5(pid=2319): stderr: | 20221209062850643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062850643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062850643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062850644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062850644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062850644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062850644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:52.064816 run osmo-stp_10.42.42.5(pid=2319): stdout: | (launched: 2022-12-09_06:28:50.447164) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:28:52.188837 run osmo-stp_10.42.42.5(pid=2319): stderr: | 20221209062850643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062850643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062850643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062850644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062850644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062850644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062850644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:28:52.338190 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2319): Process ended prematurely: osmo-stp_10.42.42.5(pid=2319) [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2319)] [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 06:28:52.346830 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 06:28:52.373795 run osmo-hlr_10.42.42.2(pid=2316): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2316)] 06:28:52.423286 run osmo-hlr_10.42.42.2(pid=2316): stdout: | (launched: 2022-12-09_06:28:49.480766) 06:28:52.474674 run osmo-hlr_10.42.42.2(pid=2316): stderr: | 20221209062849677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062849678 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062849678 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062849678 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062849678 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062849678 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062849690 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062849698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062849699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062849699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:28:52.546049 run osmo-msc_10.42.42.6(pid=2322): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2322)] 06:28:52.595595 run osmo-msc_10.42.42.6(pid=2322): stdout: | (launched: 2022-12-09_06:28:51.436311) 06:28:52.646753 run osmo-msc_10.42.42.6(pid=2322): stderr: | 20221209062851758 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062851758 DLGLOBAL DEBUG validating counter group 0x7f5b1cac5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062851758 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062851758 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062851758 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062851759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062851760 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062851761 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062851761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062851761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:28:52.698386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2315): Terminating (SIGTERM) 06:28:52.739992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2318): Terminating (SIGTERM) 06:28:52.781521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2321): Terminating (SIGTERM) 06:28:52.823649 --- ParallelTerminationStrategy: PID 2315 died... 06:28:52.843459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2315): Terminated: ok {rc=0} 06:28:52.889504 --- ParallelTerminationStrategy: PID 2318 died... 06:28:52.908713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2318): Terminated: ok {rc=0} 06:28:52.954685 --- ParallelTerminationStrategy: PID 2321 died... 06:28:52.974053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2321): Terminated: ok {rc=0} 06:28:53.060568 bus /sierra_3: Setting Powered False 06:28:54.159470 bus /sierra_3: Setting Powered False 06:28:55.275204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:28:56.494321 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:28:56.498890 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:28:56.522812 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 06:28:56.529808 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:28:56.564700 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:28:56.588006 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 06:28:56.594930 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:28:57.113479 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:28:57.118611 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 06:28:57.129501 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:28:57.168036 tst assert_extension.py: using LAC 19571 06:28:57.282048 tst assert_extension.py: using RAC 191 06:28:57.398183 tst assert_extension.py: using CellId 19571 06:28:57.514221 tst assert_extension.py: using BVCI 19572 06:28:57.621640 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:28:57.738294 tst assert_extension.py:10: start nitb and bts... 06:28:57.948233 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:28:58.584334 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2327): Launched 06:28:58.896619 run osmo-nitb_10.42.42.2(pid=2328): Launched 06:28:59.068580 run osmo-nitb_10.42.42.2(pid=2328): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2328)] 06:28:59.208708 run osmo-nitb_10.42.42.2(pid=2328): stdout: | (launched: 2022-12-09_06:28:58.840104) 06:28:59.350727 run osmo-nitb_10.42.42.2(pid=2328): stderr: | (launched: 2022-12-09_06:28:58.886785) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:28:59.492748 run osmo-nitb_10.42.42.2(pid=2328): stdout: | (launched: 2022-12-09_06:28:58.840104) 06:28:59.628442 run osmo-nitb_10.42.42.2(pid=2328): stderr: | (launched: 2022-12-09_06:28:58.886785) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2328): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2328) [trial-2355↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2328)] 06:29:00.013525 tst osmo-nitb_10.42.42.2(pid=2328): stdout: | (launched: 2022-12-09_06:28:58.840104) 06:29:00.139399 tst osmo-nitb_10.42.42.2(pid=2328): stderr: | (launched: 2022-12-09_06:28:58.886785) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:29:00.287886 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2328): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2328) [trial-2355↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2328)] [trial-2355↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 06:29:00.296906 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:29:00.304228 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2327): Terminating (SIGTERM) 06:29:00.515395 --- ParallelTerminationStrategy: PID 2327 died... 06:29:00.537964 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2327): Terminated: ok {rc=0} 06:29:00.625525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:nanobts+band-1900 --------------------------------------------------------------------- 06:29:01.795484 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:01.804356 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:29:01.839045 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:29:01.876114 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 06:29:01.916017 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:29:01.943732 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:29:01.974986 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 06:29:02.497812 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 06:29:02.504791 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:02.516039 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:29:02.554755 tst assert_extension.py: using LAC 19572 06:29:02.671202 tst assert_extension.py: using RAC 192 06:29:02.786517 tst assert_extension.py: using CellId 19572 06:29:02.900595 tst assert_extension.py: using BVCI 19573 06:29:03.005672 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:03.016472 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:03.027153 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:03.038205 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:03.049225 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:29:03.060041 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 06:29:03.173516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:03.621947 run create_hlr_db(pid=2332): Launched 06:29:03.731990 bus /sierra_2: Setting Powered False 06:29:04.789808 run create_hlr_db(pid=2332): Terminated: ok {rc=0} 06:29:05.218785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Launched 06:29:05.530010 run osmo-hlr_10.42.42.2(pid=2335): Launched 06:29:05.649149 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:06.187509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Launched 06:29:06.499538 run osmo-stp_10.42.42.5(pid=2338): Launched 06:29:06.618762 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:07.182538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2340): Launched 06:29:07.493641 run osmo-msc_10.42.42.6(pid=2341): Launched 06:29:07.667701 run osmo-stp_10.42.42.5(pid=2338): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] 06:29:07.799159 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-09_06:29:06.442857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:07.931789 run osmo-stp_10.42.42.5(pid=2338): stderr: | 20221209062906633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062906634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062906634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062906634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062906635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062906635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062906635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:08.063669 run osmo-stp_10.42.42.5(pid=2338): stdout: | (launched: 2022-12-09_06:29:06.442857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:08.187716 run osmo-stp_10.42.42.5(pid=2338): stderr: | 20221209062906633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062906634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062906634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062906634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062906635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062906635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062906635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:08.336331 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py:17] 06:29:08.344930 tst assert_extension.py:17: Test FAILED (5.8 sec) 06:29:08.372224 run osmo-hlr_10.42.42.2(pid=2335): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2335)] 06:29:08.422288 run osmo-hlr_10.42.42.2(pid=2335): stdout: | (launched: 2022-12-09_06:29:05.473636) 06:29:08.474127 run osmo-hlr_10.42.42.2(pid=2335): stderr: | 20221209062905669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062905669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062905669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062905669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062905669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062905670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062905685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062905693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062905693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062905693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:08.546038 run osmo-msc_10.42.42.6(pid=2341): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2341)] 06:29:08.595998 run osmo-msc_10.42.42.6(pid=2341): stdout: | (launched: 2022-12-09_06:29:07.437105) 06:29:08.647576 run osmo-msc_10.42.42.6(pid=2341): stderr: | 20221209062907755 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062907755 DLGLOBAL DEBUG validating counter group 0x7f1ff61b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062907755 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062907756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062907756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062907756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062907758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062907758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062907759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062907759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:08.699863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminating (SIGTERM) 06:29:08.741360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminating (SIGTERM) 06:29:08.782892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2340): Terminating (SIGTERM) 06:29:08.825020 --- ParallelTerminationStrategy: PID 2334 died... 06:29:08.844880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2334): Terminated: ok {rc=0} 06:29:08.890643 --- ParallelTerminationStrategy: PID 2337 died... 06:29:08.909924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2337): Terminated: ok {rc=0} 06:29:08.955331 --- ParallelTerminationStrategy: PID 2340 died... 06:29:08.974728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2340): Terminated: ok {rc=0} 06:29:09.061637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:29:10.263331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:10.271798 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:29:10.296493 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:29:10.324349 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:29:10.376637 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:29:10.401596 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:29:10.428897 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:29:10.981254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:29:11.031711 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.042987 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:29:11.101387 tst mo_mt_call.py: using LAC 19573 06:29:11.218237 tst mo_mt_call.py: using RAC 193 06:29:11.336069 tst mo_mt_call.py: using CellId 19573 06:29:11.453371 tst mo_mt_call.py: using BVCI 19574 06:29:11.560811 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.572120 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.583103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.594453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.605918 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:11.617264 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:29:11.737783 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:29:11.857185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:12.347629 run create_hlr_db(pid=2346): Launched 06:29:12.476367 bus /sierra_2: Setting Powered False 06:29:13.539726 run create_hlr_db(pid=2346): Terminated: ok {rc=0} 06:29:13.960328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2348): Launched 06:29:14.254323 run osmo-hlr_10.42.42.2(pid=2349): Launched 06:29:14.366384 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:14.873223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2351): Launched 06:29:15.167495 run osmo-stp_10.42.42.5(pid=2352): Launched 06:29:15.279883 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:15.814823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2354): Launched 06:29:16.169387 run osmo-msc_10.42.42.6(pid=2355): Launched 06:29:16.645575 run osmo-stp_10.42.42.5(pid=2352): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2352)] 06:29:17.032815 run osmo-stp_10.42.42.5(pid=2352): stdout: | (launched: 2022-12-09_06:29:15.113706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:17.274931 run osmo-stp_10.42.42.5(pid=2352): stderr: | 20221209062915283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062915283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062915283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062915284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062915284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062915284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062915284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:17.413166 run osmo-stp_10.42.42.5(pid=2352): stdout: | (launched: 2022-12-09_06:29:15.113706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:17.542510 run osmo-stp_10.42.42.5(pid=2352): stderr: | 20221209062915283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062915283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062915283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062915284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062915284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062915284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062915284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:17.695044 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2352): Process ended prematurely: osmo-stp_10.42.42.5(pid=2352) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2352)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:29:17.704454 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 06:29:17.732477 run osmo-hlr_10.42.42.2(pid=2349): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2349)] 06:29:17.783232 run osmo-hlr_10.42.42.2(pid=2349): stdout: | (launched: 2022-12-09_06:29:14.200858) 06:29:17.835921 run osmo-hlr_10.42.42.2(pid=2349): stderr: | 20221209062914376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062914376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062914377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062914377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062914377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062914377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062914390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062914398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062914398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062914398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:17.909036 run osmo-msc_10.42.42.6(pid=2355): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2355)] 06:29:17.959515 run osmo-msc_10.42.42.6(pid=2355): stdout: | (launched: 2022-12-09_06:29:16.102756) 06:29:18.011312 run osmo-msc_10.42.42.6(pid=2355): stderr: | 20221209062916758 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062916759 DLGLOBAL DEBUG validating counter group 0x7fbe1214cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062916759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062916759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062916760 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062916761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062916765 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062916765 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062916765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062916765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:18.063619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2348): Terminating (SIGTERM) 06:29:18.105818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2351): Terminating (SIGTERM) 06:29:18.148019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2354): Terminating (SIGTERM) 06:29:18.190236 --- ParallelTerminationStrategy: PID 2348 died... 06:29:18.210368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2348): Terminated: ok {rc=0} 06:29:18.257263 --- ParallelTerminationStrategy: PID 2351 died... 06:29:18.277090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2351): Terminated: ok {rc=0} 06:29:18.323909 --- ParallelTerminationStrategy: PID 2354 died... 06:29:18.343890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2354): Terminated: ok {rc=0} 06:29:18.431667 bus /sierra_3: Setting Powered False 06:29:19.530302 bus /sierra_3: Setting Powered False 06:29:20.645442 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:29:21.793659 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:21.806133 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:29:21.867554 tst mo_mt_call_osmux.py: using LAC 19574 06:29:21.992429 tst mo_mt_call_osmux.py: using RAC 194 06:29:22.122002 tst mo_mt_call_osmux.py: using CellId 19574 06:29:22.246437 tst mo_mt_call_osmux.py: using BVCI 19575 06:29:22.361838 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:22.373501 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:22.384822 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:22.396201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:22.407620 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:29:22.419006 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:29:22.535201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:29:22.653452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:23.146369 run create_hlr_db(pid=2357): Launched 06:29:23.275065 bus /sierra_2: Setting Powered False 06:29:24.337891 run create_hlr_db(pid=2357): Terminated: ok {rc=0} 06:29:24.761926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2359): Launched 06:29:25.056786 run osmo-hlr_10.42.42.2(pid=2360): Launched 06:29:25.168875 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:25.680189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2362): Launched 06:29:25.976420 run osmo-stp_10.42.42.5(pid=2363): Launched 06:29:26.089598 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:26.625074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2365): Launched 06:29:26.920668 run osmo-msc_10.42.42.6(pid=2366): Launched 06:29:27.085702 run osmo-stp_10.42.42.5(pid=2363): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2363)] 06:29:27.212463 run osmo-stp_10.42.42.5(pid=2363): stdout: | (launched: 2022-12-09_06:29:25.921623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:27.338880 run osmo-stp_10.42.42.5(pid=2363): stderr: | 20221209062926092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062926092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062926092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062926093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062926093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062926093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062926093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:27.462554 run osmo-stp_10.42.42.5(pid=2363): stdout: | (launched: 2022-12-09_06:29:25.921623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:27.580234 run osmo-stp_10.42.42.5(pid=2363): stderr: | 20221209062926092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062926092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062926092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062926093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062926093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062926093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062926093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:27.720783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2363): Process ended prematurely: osmo-stp_10.42.42.5(pid=2363) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2363)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:29:27.729785 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:29:27.756459 run osmo-hlr_10.42.42.2(pid=2360): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2360)] 06:29:27.804929 run osmo-hlr_10.42.42.2(pid=2360): stdout: | (launched: 2022-12-09_06:29:25.002959) 06:29:27.854804 run osmo-hlr_10.42.42.2(pid=2360): stderr: | 20221209062925176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062925176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062925176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062925176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062925176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062925176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062925190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062925198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062925199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062925199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:27.924208 run osmo-msc_10.42.42.6(pid=2366): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2366)] 06:29:27.971981 run osmo-msc_10.42.42.6(pid=2366): stdout: | (launched: 2022-12-09_06:29:26.866425) 06:29:28.021880 run osmo-msc_10.42.42.6(pid=2366): stderr: | 20221209062927138 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062927138 DLGLOBAL DEBUG validating counter group 0x7f2fdae77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062927138 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062927138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062927138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062927139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062927142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062927142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062927143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062927143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:28.072248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2359): Terminating (SIGTERM) 06:29:28.112570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2362): Terminating (SIGTERM) 06:29:28.152501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2365): Terminating (SIGTERM) 06:29:28.192815 --- ParallelTerminationStrategy: PID 2359 died... 06:29:28.212120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2359): Terminated: ok {rc=0} 06:29:28.256780 --- ParallelTerminationStrategy: PID 2362 died... 06:29:28.275528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2362): Terminated: ok {rc=0} 06:29:28.320088 --- ParallelTerminationStrategy: PID 2365 died... 06:29:28.338814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2365): Terminated: ok {rc=0} 06:29:28.426044 bus /sierra_3: Setting Powered False 06:29:29.524510 bus /sierra_3: Setting Powered False 06:29:30.636860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:29:31.884242 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:31.894098 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:29:31.918788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:29:31.946295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:29:31.999273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:29:32.023886 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:29:32.053274 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:29:32.604524 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:29:32.654750 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:32.666378 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:29:32.726213 tst mo_mt_call.py: using LAC 19575 06:29:32.850006 tst mo_mt_call.py: using RAC 195 06:29:32.974809 tst mo_mt_call.py: using CellId 19575 06:29:33.099572 tst mo_mt_call.py: using BVCI 19576 06:29:33.215079 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:33.226602 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:33.238051 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:33.249403 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:33.260757 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:33.272122 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:33.385364 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:33.498433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:33.957493 run create_hlr_db(pid=2371): Launched 06:29:34.071004 bus /sierra_2: Setting Powered False 06:29:35.129941 run create_hlr_db(pid=2371): Terminated: ok {rc=0} 06:29:35.541395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2373): Launched 06:29:35.836136 run osmo-hlr_10.42.42.2(pid=2374): Launched 06:29:35.948580 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:36.457293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2376): Launched 06:29:36.753193 run osmo-stp_10.42.42.5(pid=2377): Launched 06:29:36.866009 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:37.399636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2379): Launched 06:29:37.694964 run osmo-msc_10.42.42.6(pid=2380): Launched 06:29:37.859887 run osmo-stp_10.42.42.5(pid=2377): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2377)] 06:29:37.986664 run osmo-stp_10.42.42.5(pid=2377): stdout: | (launched: 2022-12-09_06:29:36.699354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:38.112767 run osmo-stp_10.42.42.5(pid=2377): stderr: | 20221209062936867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062936867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062936868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062936868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062936869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062936869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062936869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:38.237338 run osmo-stp_10.42.42.5(pid=2377): stdout: | (launched: 2022-12-09_06:29:36.699354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:38.355263 run osmo-stp_10.42.42.5(pid=2377): stderr: | 20221209062936867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062936867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062936868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062936868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062936869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062936869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062936869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:38.496575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2377): Process ended prematurely: osmo-stp_10.42.42.5(pid=2377) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2377)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:29:38.505450 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:29:38.532029 run osmo-hlr_10.42.42.2(pid=2374): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2374)] 06:29:38.579866 run osmo-hlr_10.42.42.2(pid=2374): stdout: | (launched: 2022-12-09_06:29:35.782399) 06:29:38.629627 run osmo-hlr_10.42.42.2(pid=2374): stderr: | 20221209062935957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062935957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062935957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062935957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062935957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062935957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062935968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062935977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062935977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062935977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:38.698484 run osmo-msc_10.42.42.6(pid=2380): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2380)] 06:29:38.746160 run osmo-msc_10.42.42.6(pid=2380): stdout: | (launched: 2022-12-09_06:29:37.640908) 06:29:38.795424 run osmo-msc_10.42.42.6(pid=2380): stderr: | 20221209062937911 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062937911 DLGLOBAL DEBUG validating counter group 0x7f13c938bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062937911 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062937911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062937911 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062937912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062937913 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062937914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062937914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062937914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:38.845314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2373): Terminating (SIGTERM) 06:29:38.885319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2376): Terminating (SIGTERM) 06:29:38.925391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2379): Terminating (SIGTERM) 06:29:38.965797 --- ParallelTerminationStrategy: PID 2373 died... 06:29:38.984871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2373): Terminated: ok {rc=0} 06:29:39.029701 --- ParallelTerminationStrategy: PID 2376 died... 06:29:39.048212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2376): Terminated: ok {rc=0} 06:29:39.092760 --- ParallelTerminationStrategy: PID 2379 died... 06:29:39.111535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2379): Terminated: ok {rc=0} 06:29:39.197745 bus /sierra_3: Setting Powered False 06:29:40.296138 bus /sierra_3: Setting Powered False 06:29:41.407706 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:29:42.555175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:42.567247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:29:42.631351 tst mo_mt_call_osmux.py: using LAC 19576 06:29:42.756620 tst mo_mt_call_osmux.py: using RAC 196 06:29:42.881202 tst mo_mt_call_osmux.py: using CellId 19576 06:29:43.003690 tst mo_mt_call_osmux.py: using BVCI 19577 06:29:43.119129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:43.130766 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:43.142139 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:43.153474 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:43.164779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:29:43.176256 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:43.294164 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:29:43.411815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:43.903094 run create_hlr_db(pid=2382): Launched 06:29:44.031647 bus /sierra_2: Setting Powered False 06:29:45.094240 run create_hlr_db(pid=2382): Terminated: ok {rc=0} 06:29:45.517042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2384): Launched 06:29:45.811489 run osmo-hlr_10.42.42.2(pid=2385): Launched 06:29:45.956368 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:46.663974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2387): Launched 06:29:47.003888 run osmo-stp_10.42.42.5(pid=2388): Launched 06:29:47.279087 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:47.855162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2390): Launched 06:29:48.172522 run osmo-msc_10.42.42.6(pid=2391): Launched 06:29:48.349761 run osmo-stp_10.42.42.5(pid=2388): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2388)] 06:29:48.484829 run osmo-stp_10.42.42.5(pid=2388): stdout: | (launched: 2022-12-09_06:29:46.933758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:48.619703 run osmo-stp_10.42.42.5(pid=2388): stderr: | 20221209062947164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062947164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062947164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062947165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062947165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062947165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062947165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:48.754265 run osmo-stp_10.42.42.5(pid=2388): stdout: | (launched: 2022-12-09_06:29:46.933758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:48.880861 run osmo-stp_10.42.42.5(pid=2388): stderr: | 20221209062947164 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062947164 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062947164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062947165 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062947165 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062947165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062947165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:49.032051 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2388): Process ended prematurely: osmo-stp_10.42.42.5(pid=2388) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2388)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:29:49.041731 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 06:29:49.069397 run osmo-hlr_10.42.42.2(pid=2385): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2385)] 06:29:49.119299 run osmo-hlr_10.42.42.2(pid=2385): stdout: | (launched: 2022-12-09_06:29:45.757845) 06:29:49.171099 run osmo-hlr_10.42.42.2(pid=2385): stderr: | 20221209062946063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062946063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062946063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062946063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062946063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062946063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062946075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062946088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062946088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062946088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:29:49.243374 run osmo-msc_10.42.42.6(pid=2391): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2391)] 06:29:49.293252 run osmo-msc_10.42.42.6(pid=2391): stdout: | (launched: 2022-12-09_06:29:48.115062) 06:29:49.344893 run osmo-msc_10.42.42.6(pid=2391): stderr: | 20221209062948435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062948435 DLGLOBAL DEBUG validating counter group 0x7fa1feefbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062948436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062948436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062948436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062948436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062948438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062948438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062948438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062948438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:29:49.396745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2384): Terminating (SIGTERM) 06:29:49.438541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2387): Terminating (SIGTERM) 06:29:49.480233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2390): Terminating (SIGTERM) 06:29:49.522158 --- ParallelTerminationStrategy: PID 2384 died... 06:29:49.542097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2384): Terminated: ok {rc=0} 06:29:49.588255 --- ParallelTerminationStrategy: PID 2387 died... 06:29:49.607888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2387): Terminated: ok {rc=0} 06:29:49.653854 --- ParallelTerminationStrategy: PID 2390 died... 06:29:49.673473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2390): Terminated: ok {rc=0} 06:29:49.761225 bus /sierra_3: Setting Powered False 06:29:50.860263 bus /sierra_3: Setting Powered False 06:29:51.975637 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:29:53.218610 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:29:53.226999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:29:53.251367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:29:53.278501 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:29:53.332141 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:29:53.357520 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:29:53.384859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:29:53.935228 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:29:53.986301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:53.998170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:29:54.058452 tst mo_mt_call.py: using LAC 19577 06:29:54.183605 tst mo_mt_call.py: using RAC 197 06:29:54.308793 tst mo_mt_call.py: using CellId 19577 06:29:54.433639 tst mo_mt_call.py: using BVCI 19578 06:29:54.549594 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:54.561336 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:54.572666 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:54.584127 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:54.595583 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:29:54.607078 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:54.721736 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:29:54.837484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:29:55.294141 run create_hlr_db(pid=2396): Launched 06:29:55.407463 bus /sierra_2: Setting Powered False 06:29:56.466606 run create_hlr_db(pid=2396): Terminated: ok {rc=0} 06:29:56.879127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2398): Launched 06:29:57.172918 run osmo-hlr_10.42.42.2(pid=2399): Launched 06:29:57.285294 run osmo-stp_10.42.42.5: Starting osmo-stp 06:29:57.791867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2401): Launched 06:29:58.087000 run osmo-stp_10.42.42.5(pid=2402): Launched 06:29:58.199414 run osmo-msc_10.42.42.6: Starting osmo-msc 06:29:58.733255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2404): Launched 06:29:59.028930 run osmo-msc_10.42.42.6(pid=2405): Launched 06:29:59.195248 run osmo-stp_10.42.42.5(pid=2402): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2402)] 06:29:59.322364 run osmo-stp_10.42.42.5(pid=2402): stdout: | (launched: 2022-12-09_06:29:58.032693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:59.448786 run osmo-stp_10.42.42.5(pid=2402): stderr: | 20221209062958201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062958201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062958201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062958202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062958202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062958202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062958202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:59.572904 run osmo-stp_10.42.42.5(pid=2402): stdout: | (launched: 2022-12-09_06:29:58.032693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:29:59.691064 run osmo-stp_10.42.42.5(pid=2402): stderr: | 20221209062958201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209062958201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209062958201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209062958202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209062958202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209062958202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209062958202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:29:59.832327 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2402): Process ended prematurely: osmo-stp_10.42.42.5(pid=2402) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2402)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:29:59.841283 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:29:59.867814 run osmo-hlr_10.42.42.2(pid=2399): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2399)] 06:29:59.915825 run osmo-hlr_10.42.42.2(pid=2399): stdout: | (launched: 2022-12-09_06:29:57.119435) 06:29:59.965435 run osmo-hlr_10.42.42.2(pid=2399): stderr: | 20221209062957292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209062957292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209062957292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209062957292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209062957292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209062957292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209062957304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209062957312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209062957312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209062957312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:00.034805 run osmo-msc_10.42.42.6(pid=2405): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2405)] 06:30:00.082855 run osmo-msc_10.42.42.6(pid=2405): stdout: | (launched: 2022-12-09_06:29:58.975100) 06:30:00.132224 run osmo-msc_10.42.42.6(pid=2405): stderr: | 20221209062959246 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209062959246 DLGLOBAL DEBUG validating counter group 0x7f50a52ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209062959246 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209062959246 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209062959246 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209062959246 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209062959249 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209062959249 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209062959249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209062959249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:00.182187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2398): Terminating (SIGTERM) 06:30:00.222666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2401): Terminating (SIGTERM) 06:30:00.262834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2404): Terminating (SIGTERM) 06:30:00.303173 --- ParallelTerminationStrategy: PID 2398 died... 06:30:00.322322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2398): Terminated: ok {rc=0} 06:30:00.366716 --- ParallelTerminationStrategy: PID 2401 died... 06:30:00.385521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2401): Terminated: ok {rc=0} 06:30:00.430034 --- ParallelTerminationStrategy: PID 2404 died... 06:30:00.448671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2404): Terminated: ok {rc=0} 06:30:00.534771 bus /sierra_3: Setting Powered False 06:30:01.634702 bus /sierra_3: Setting Powered False 06:30:02.752371 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:30:03.896879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:03.908629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:30:03.968432 tst mo_mt_call_osmux.py: using LAC 19578 06:30:04.092759 tst mo_mt_call_osmux.py: using RAC 198 06:30:04.220088 tst mo_mt_call_osmux.py: using CellId 19578 06:30:04.337394 tst mo_mt_call_osmux.py: using BVCI 19579 06:30:04.445353 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:04.456593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:04.467801 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:04.478661 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:04.491139 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:30:04.502593 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:30:04.619854 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:30:04.734317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:05.193450 run create_hlr_db(pid=2410): Launched 06:30:05.305728 bus /sierra_2: Setting Powered False 06:30:06.365467 run create_hlr_db(pid=2410): Terminated: ok {rc=0} 06:30:06.777702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2412): Launched 06:30:07.073682 run osmo-hlr_10.42.42.2(pid=2413): Launched 06:30:07.186763 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:07.693841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2415): Launched 06:30:07.987990 run osmo-stp_10.42.42.5(pid=2416): Launched 06:30:08.101057 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:08.640060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2418): Launched 06:30:08.936800 run osmo-msc_10.42.42.6(pid=2419): Launched 06:30:09.102125 run osmo-stp_10.42.42.5(pid=2416): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2416)] 06:30:09.229805 run osmo-stp_10.42.42.5(pid=2416): stdout: | (launched: 2022-12-09_06:30:07.934427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:09.356601 run osmo-stp_10.42.42.5(pid=2416): stderr: | 20221209063008101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063008101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063008101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063008102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063008104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063008104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063008104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:09.480283 run osmo-stp_10.42.42.5(pid=2416): stdout: | (launched: 2022-12-09_06:30:07.934427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:09.598017 run osmo-stp_10.42.42.5(pid=2416): stderr: | 20221209063008101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063008101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063008101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063008102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063008104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063008104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063008104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:09.738596 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2416): Process ended prematurely: osmo-stp_10.42.42.5(pid=2416) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2416)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:30:09.747359 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 06:30:09.773735 run osmo-hlr_10.42.42.2(pid=2413): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2413)] 06:30:09.821335 run osmo-hlr_10.42.42.2(pid=2413): stdout: | (launched: 2022-12-09_06:30:07.019639) 06:30:09.870282 run osmo-hlr_10.42.42.2(pid=2413): stderr: | 20221209063007192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063007192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063007192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063007192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063007192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063007192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063007204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063007212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063007213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063007213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:09.939034 run osmo-msc_10.42.42.6(pid=2419): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2419)] 06:30:09.986287 run osmo-msc_10.42.42.6(pid=2419): stdout: | (launched: 2022-12-09_06:30:08.882616) 06:30:10.035333 run osmo-msc_10.42.42.6(pid=2419): stderr: | 20221209063009155 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063009155 DLGLOBAL DEBUG validating counter group 0x7fc450cb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063009155 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063009156 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063009156 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063009156 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063009158 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063009158 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063009158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063009158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:10.084787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2412): Terminating (SIGTERM) 06:30:10.124538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2415): Terminating (SIGTERM) 06:30:10.164079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2418): Terminating (SIGTERM) 06:30:10.203876 --- ParallelTerminationStrategy: PID 2412 died... 06:30:10.222850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2412): Terminated: ok {rc=0} 06:30:10.266702 --- ParallelTerminationStrategy: PID 2415 died... 06:30:10.285437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2415): Terminated: ok {rc=0} 06:30:10.329331 --- ParallelTerminationStrategy: PID 2418 died... 06:30:10.347723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2418): Terminated: ok {rc=0} 06:30:10.430569 bus /sierra_3: Setting Powered False 06:30:11.528770 bus /sierra_3: Setting Powered False 06:30:12.644330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:30:13.885792 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:13.893906 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:30:13.918546 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:30:13.945806 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:30:13.998060 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:30:14.022279 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:30:14.049256 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:30:14.598310 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:30:14.646080 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:14.657194 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:30:14.717080 tst mo_mt_call.py: using LAC 19579 06:30:14.844198 tst mo_mt_call.py: using RAC 199 06:30:14.970593 tst mo_mt_call.py: using CellId 19579 06:30:15.096724 tst mo_mt_call.py: using BVCI 19580 06:30:15.211869 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:15.223548 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:15.235065 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:15.246752 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:15.258511 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:15.270335 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:30:15.385791 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:30:15.506747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:15.992598 run create_hlr_db(pid=2424): Launched 06:30:16.144849 bus /sierra_2: Setting Powered False 06:30:17.215778 run create_hlr_db(pid=2424): Terminated: ok {rc=0} 06:30:17.649499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2426): Launched 06:30:17.944819 run osmo-hlr_10.42.42.2(pid=2427): Launched 06:30:18.057272 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:18.566869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2429): Launched 06:30:18.861664 run osmo-stp_10.42.42.5(pid=2430): Launched 06:30:18.974670 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:19.510577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2432): Launched 06:30:19.805711 run osmo-msc_10.42.42.6(pid=2433): Launched 06:30:19.972033 run osmo-stp_10.42.42.5(pid=2430): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2430)] 06:30:20.099106 run osmo-stp_10.42.42.5(pid=2430): stdout: | (launched: 2022-12-09_06:30:18.807851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:20.225647 run osmo-stp_10.42.42.5(pid=2430): stderr: | 20221209063018975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063018975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063018975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063018975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063018978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063018978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063018978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:20.349909 run osmo-stp_10.42.42.5(pid=2430): stdout: | (launched: 2022-12-09_06:30:18.807851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:20.467450 run osmo-stp_10.42.42.5(pid=2430): stderr: | 20221209063018975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063018975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063018975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063018975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063018978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063018978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063018978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:20.608518 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2430): Process ended prematurely: osmo-stp_10.42.42.5(pid=2430) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2430)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:30:20.617527 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:30:20.644207 run osmo-hlr_10.42.42.2(pid=2427): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2427)] 06:30:20.692433 run osmo-hlr_10.42.42.2(pid=2427): stdout: | (launched: 2022-12-09_06:30:17.891194) 06:30:20.742526 run osmo-hlr_10.42.42.2(pid=2427): stderr: | 20221209063018064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063018064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063018064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063018064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063018065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063018065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063018077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063018088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063018088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063018088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:20.812164 run osmo-msc_10.42.42.6(pid=2433): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2433)] 06:30:20.860171 run osmo-msc_10.42.42.6(pid=2433): stdout: | (launched: 2022-12-09_06:30:19.751762) 06:30:20.909799 run osmo-msc_10.42.42.6(pid=2433): stderr: | 20221209063020018 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063020019 DLGLOBAL DEBUG validating counter group 0x7fde999c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063020019 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063020019 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063020019 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063020019 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063020021 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063020021 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063020021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063020022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:20.960136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2426): Terminating (SIGTERM) 06:30:20.999998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2429): Terminating (SIGTERM) 06:30:21.040048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2432): Terminating (SIGTERM) 06:30:21.080414 --- ParallelTerminationStrategy: PID 2426 died... 06:30:21.099693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2426): Terminated: ok {rc=0} 06:30:21.144325 --- ParallelTerminationStrategy: PID 2429 died... 06:30:21.163076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2429): Terminated: ok {rc=0} 06:30:21.207400 --- ParallelTerminationStrategy: PID 2432 died... 06:30:21.226116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2432): Terminated: ok {rc=0} 06:30:21.311934 bus /sierra_3: Setting Powered False 06:30:22.410977 bus /sierra_3: Setting Powered False 06:30:23.527500 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:30:24.672555 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:24.684436 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:30:24.748522 tst mo_mt_call_osmux.py: using LAC 19580 06:30:24.865528 tst mo_mt_call_osmux.py: using RAC 200 06:30:24.989401 tst mo_mt_call_osmux.py: using CellId 19580 06:30:25.112668 tst mo_mt_call_osmux.py: using BVCI 19581 06:30:25.227666 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:25.239244 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:25.250718 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:25.262190 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:25.273878 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:30:25.285321 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:30:25.401846 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:30:25.518329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:25.977499 run create_hlr_db(pid=2435): Launched 06:30:26.091494 bus /sierra_2: Setting Powered False 06:30:27.151209 run create_hlr_db(pid=2435): Terminated: ok {rc=0} 06:30:27.584782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2437): Launched 06:30:27.902065 run osmo-hlr_10.42.42.2(pid=2438): Launched 06:30:28.022796 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:28.568464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2440): Launched 06:30:28.884837 run osmo-stp_10.42.42.5(pid=2441): Launched 06:30:29.006050 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:29.578469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2443): Launched 06:30:29.893926 run osmo-msc_10.42.42.6(pid=2444): Launched 06:30:30.069975 run osmo-stp_10.42.42.5(pid=2441): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2441)] 06:30:30.203960 run osmo-stp_10.42.42.5(pid=2441): stdout: | (launched: 2022-12-09_06:30:28.827230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:30.338105 run osmo-stp_10.42.42.5(pid=2441): stderr: | 20221209063029019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063029019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063029019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063029020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063029020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063029020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063029020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:30.471835 run osmo-stp_10.42.42.5(pid=2441): stdout: | (launched: 2022-12-09_06:30:28.827230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:30.598023 run osmo-stp_10.42.42.5(pid=2441): stderr: | 20221209063029019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063029019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063029019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063029020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063029020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063029020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063029020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:30.748637 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2441): Process ended prematurely: osmo-stp_10.42.42.5(pid=2441) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2441)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:30:30.758255 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:30:30.785924 run osmo-hlr_10.42.42.2(pid=2438): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2438)] 06:30:30.836058 run osmo-hlr_10.42.42.2(pid=2438): stdout: | (launched: 2022-12-09_06:30:27.844250) 06:30:30.890353 run osmo-hlr_10.42.42.2(pid=2438): stderr: | 20221209063028043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063028043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063028044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063028044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063028044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063028044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063028056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063028064 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063028065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063028065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:30.979711 run osmo-msc_10.42.42.6(pid=2444): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2444)] 06:30:31.030758 run osmo-msc_10.42.42.6(pid=2444): stdout: | (launched: 2022-12-09_06:30:29.836019) 06:30:31.087667 run osmo-msc_10.42.42.6(pid=2444): stderr: | 20221209063030159 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063030159 DLGLOBAL DEBUG validating counter group 0x7f4ac9361c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063030159 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063030159 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063030159 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063030159 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063030161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063030162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063030162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063030162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:31.141065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2437): Terminating (SIGTERM) 06:30:31.184437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2440): Terminating (SIGTERM) 06:30:31.228661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2443): Terminating (SIGTERM) 06:30:31.272579 --- ParallelTerminationStrategy: PID 2437 died... 06:30:31.292900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2437): Terminated: ok {rc=0} 06:30:31.341655 --- ParallelTerminationStrategy: PID 2440 died... 06:30:31.361870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2440): Terminated: ok {rc=0} 06:30:31.409123 --- ParallelTerminationStrategy: PID 2443 died... 06:30:31.429340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2443): Terminated: ok {rc=0} 06:30:31.518056 bus /sierra_3: Setting Powered False 06:30:32.616702 bus /sierra_3: Setting Powered False 06:30:33.730596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:30:34.970957 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:34.979002 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:30:35.003458 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:30:35.030642 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:30:35.082825 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:30:35.107313 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:30:35.134508 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:30:35.688622 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:30:35.739489 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:35.751236 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:30:35.811956 tst mo_mt_call.py: using LAC 19581 06:30:35.936599 tst mo_mt_call.py: using RAC 201 06:30:36.062268 tst mo_mt_call.py: using CellId 19581 06:30:36.188008 tst mo_mt_call.py: using BVCI 19582 06:30:36.302734 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:36.314356 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:36.325807 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:36.337380 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:36.348792 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:36.360189 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:36.475759 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:36.592405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:37.084077 run create_hlr_db(pid=2449): Launched 06:30:37.212338 bus /sierra_2: Setting Powered False 06:30:38.276173 run create_hlr_db(pid=2449): Terminated: ok {rc=0} 06:30:38.698931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2451): Launched 06:30:38.993182 run osmo-hlr_10.42.42.2(pid=2452): Launched 06:30:39.106104 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:39.627463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2454): Launched 06:30:39.922377 run osmo-stp_10.42.42.5(pid=2455): Launched 06:30:40.035066 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:40.571242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2457): Launched 06:30:40.866464 run osmo-msc_10.42.42.6(pid=2458): Launched 06:30:41.032088 run osmo-stp_10.42.42.5(pid=2455): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2455)] 06:30:41.158728 run osmo-stp_10.42.42.5(pid=2455): stdout: | (launched: 2022-12-09_06:30:39.868609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:41.287105 run osmo-stp_10.42.42.5(pid=2455): stderr: | 20221209063040038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063040038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063040039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063040039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063040039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063040040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063040040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:41.410616 run osmo-stp_10.42.42.5(pid=2455): stdout: | (launched: 2022-12-09_06:30:39.868609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:41.528256 run osmo-stp_10.42.42.5(pid=2455): stderr: | 20221209063040038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063040038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063040039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063040039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063040039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063040040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063040040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:41.668940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2455): Process ended prematurely: osmo-stp_10.42.42.5(pid=2455) [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2455)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:30:41.677856 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:30:41.704253 run osmo-hlr_10.42.42.2(pid=2452): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2452)] 06:30:41.752329 run osmo-hlr_10.42.42.2(pid=2452): stdout: | (launched: 2022-12-09_06:30:38.939586) 06:30:41.801674 run osmo-hlr_10.42.42.2(pid=2452): stderr: | 20221209063039116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063039116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063039116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063039116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063039116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063039116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063039128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063039138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063039138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063039138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:41.870572 run osmo-msc_10.42.42.6(pid=2458): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2458)] 06:30:41.918216 run osmo-msc_10.42.42.6(pid=2458): stdout: | (launched: 2022-12-09_06:30:40.812272) 06:30:41.967337 run osmo-msc_10.42.42.6(pid=2458): stderr: | 20221209063041083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063041083 DLGLOBAL DEBUG validating counter group 0x7f6e54916c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063041084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063041084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063041084 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063041084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063041086 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063041086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063041087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063041087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:42.017069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2451): Terminating (SIGTERM) 06:30:42.057099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2454): Terminating (SIGTERM) 06:30:42.097077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2457): Terminating (SIGTERM) 06:30:42.137261 --- ParallelTerminationStrategy: PID 2451 died... 06:30:42.156230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2451): Terminated: ok {rc=0} 06:30:42.200467 --- ParallelTerminationStrategy: PID 2454 died... 06:30:42.219057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2454): Terminated: ok {rc=0} 06:30:42.263517 --- ParallelTerminationStrategy: PID 2457 died... 06:30:42.282037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2457): Terminated: ok {rc=0} 06:30:42.367666 bus /sierra_3: Setting Powered False 06:30:43.467246 bus /sierra_3: Setting Powered False 06:30:44.579859 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:30:45.725250 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:45.737597 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:30:45.798260 tst mo_mt_call_osmux.py: using LAC 19582 06:30:45.942043 tst mo_mt_call_osmux.py: using RAC 202 06:30:46.067498 tst mo_mt_call_osmux.py: using CellId 19582 06:30:46.226042 tst mo_mt_call_osmux.py: using BVCI 19583 06:30:46.338782 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:46.351352 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:46.363493 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:46.376224 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:46.390824 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:30:46.405284 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:46.537640 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:30:46.659818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:47.165745 run create_hlr_db(pid=2460): Launched 06:30:47.325467 bus /sierra_2: Setting Powered False 06:30:48.388328 run create_hlr_db(pid=2460): Terminated: ok {rc=0} 06:30:48.810505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2462): Launched 06:30:49.105474 run osmo-hlr_10.42.42.2(pid=2463): Launched 06:30:49.218115 run osmo-stp_10.42.42.5: Starting osmo-stp 06:30:49.726173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2465): Launched 06:30:50.021414 run osmo-stp_10.42.42.5(pid=2466): Launched 06:30:50.133959 run osmo-msc_10.42.42.6: Starting osmo-msc 06:30:50.669461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2468): Launched 06:30:50.965885 run osmo-msc_10.42.42.6(pid=2469): Launched 06:30:51.131086 run osmo-stp_10.42.42.5(pid=2466): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2466)] 06:30:51.265608 run osmo-stp_10.42.42.5(pid=2466): stdout: | (launched: 2022-12-09_06:30:49.967297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:51.402681 run osmo-stp_10.42.42.5(pid=2466): stderr: | 20221209063050137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063050137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063050137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063050138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063050140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063050140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063050140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:51.535992 run osmo-stp_10.42.42.5(pid=2466): stdout: | (launched: 2022-12-09_06:30:49.967297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:30:51.662435 run osmo-stp_10.42.42.5(pid=2466): stderr: | 20221209063050137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063050137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063050137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063050138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063050140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063050140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063050140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:30:51.813626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2466): Process ended prematurely: osmo-stp_10.42.42.5(pid=2466) [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2466)] [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:30:51.823156 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:30:51.851044 run osmo-hlr_10.42.42.2(pid=2463): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2463)] 06:30:51.901736 run osmo-hlr_10.42.42.2(pid=2463): stdout: | (launched: 2022-12-09_06:30:49.050989) 06:30:51.953678 run osmo-hlr_10.42.42.2(pid=2463): stderr: | 20221209063049226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063049226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063049226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063049226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063049226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063049226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063049238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063049249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063049249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063049249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:30:52.026461 run osmo-msc_10.42.42.6(pid=2469): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2469)] 06:30:52.076451 run osmo-msc_10.42.42.6(pid=2469): stdout: | (launched: 2022-12-09_06:30:50.911857) 06:30:52.128268 run osmo-msc_10.42.42.6(pid=2469): stderr: | 20221209063051184 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063051184 DLGLOBAL DEBUG validating counter group 0x7f341686ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063051184 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063051184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063051184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063051185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063051186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063051187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063051187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063051187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:30:52.180326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2462): Terminating (SIGTERM) 06:30:52.222232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2465): Terminating (SIGTERM) 06:30:52.264276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2468): Terminating (SIGTERM) 06:30:52.306471 --- ParallelTerminationStrategy: PID 2462 died... 06:30:52.326636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2462): Terminated: ok {rc=0} 06:30:52.373349 --- ParallelTerminationStrategy: PID 2465 died... 06:30:52.393067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2465): Terminated: ok {rc=0} 06:30:52.439354 --- ParallelTerminationStrategy: PID 2468 died... 06:30:52.459108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2468): Terminated: ok {rc=0} 06:30:52.546903 bus /sierra_3: Setting Powered False 06:30:53.647446 bus /sierra_3: Setting Powered False 06:30:54.763166 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:nanobts+band-1900 --------------------------------------------------------------------- 06:30:56.008415 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:30:56.014147 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:30:56.038269 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 06:30:56.065844 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:30:56.149071 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:30:56.173265 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 06:30:56.200328 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:30:56.787924 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 06:30:56.794112 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:56.805621 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:30:56.845042 tst emergency_mo_mt_call.py: using LAC 19583 06:30:56.957743 tst emergency_mo_mt_call.py: using RAC 203 06:30:57.071792 tst emergency_mo_mt_call.py: using CellId 19583 06:30:57.183786 tst emergency_mo_mt_call.py: using BVCI 19584 06:30:57.297998 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:57.309124 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:57.320054 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:57.330980 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:57.342045 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:30:57.352892 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:57.471661 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:30:57.589433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:30:58.069863 run create_hlr_db(pid=2476): Launched 06:30:58.194389 bus /sierra_2: Setting Powered False 06:30:59.257202 run create_hlr_db(pid=2476): Terminated: ok {rc=0} 06:30:59.673065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2478): Launched 06:30:59.961552 run osmo-hlr_10.42.42.2(pid=2479): Launched 06:31:00.071403 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:00.570497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2481): Launched 06:31:00.884916 run osmo-stp_10.42.42.5(pid=2482): Launched 06:31:01.027830 tst emergency_mo_mt_call.py: using MSISDN 7061 06:31:01.352587 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:01.903179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2484): Launched 06:31:02.215302 run osmo-msc_10.42.42.6(pid=2485): Launched 06:31:02.424288 run osmo-stp_10.42.42.5(pid=2482): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2482)] 06:31:02.549815 run osmo-stp_10.42.42.5(pid=2482): stdout: | (launched: 2022-12-09_06:31:00.806219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:02.677263 run osmo-stp_10.42.42.5(pid=2482): stderr: | 20221209063101151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063101151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063101152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063101153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063101153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063101154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063101154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:02.801390 run osmo-stp_10.42.42.5(pid=2482): stdout: | (launched: 2022-12-09_06:31:00.806219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:02.918217 run osmo-stp_10.42.42.5(pid=2482): stderr: | 20221209063101151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063101151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063101152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063101153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063101153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063101154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063101154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:03.057382 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2482): Process ended prematurely: osmo-stp_10.42.42.5(pid=2482) [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2482)] [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 06:31:03.065834 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 06:31:03.092430 run osmo-hlr_10.42.42.2(pid=2479): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2479)] 06:31:03.141433 run osmo-hlr_10.42.42.2(pid=2479): stdout: | (launched: 2022-12-09_06:30:59.908838) 06:31:03.191829 run osmo-hlr_10.42.42.2(pid=2479): stderr: | 20221209063100082 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063100082 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063100082 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063100082 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063100082 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063100082 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063100098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063100107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063100107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063100107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:03.261815 run osmo-msc_10.42.42.6(pid=2485): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2485)] 06:31:03.310429 run osmo-msc_10.42.42.6(pid=2485): stdout: | (launched: 2022-12-09_06:31:02.154841) 06:31:03.360442 run osmo-msc_10.42.42.6(pid=2485): stderr: | 20221209063102537 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063102537 DLGLOBAL DEBUG validating counter group 0x7f169c224c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063102537 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063102537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063102538 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063102538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063102540 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063102540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063102540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063102540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:03.410769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2478): Terminating (SIGTERM) 06:31:03.451319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2481): Terminating (SIGTERM) 06:31:03.491779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2484): Terminating (SIGTERM) 06:31:03.532565 --- ParallelTerminationStrategy: PID 2478 died... 06:31:03.551899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2478): Terminated: ok {rc=0} 06:31:03.597333 --- ParallelTerminationStrategy: PID 2481 died... 06:31:03.616563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2481): Terminated: ok {rc=0} 06:31:03.661343 --- ParallelTerminationStrategy: PID 2484 died... 06:31:03.680159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2484): Terminated: ok {rc=0} 06:31:03.764418 bus /sierra_3: Setting Powered False 06:31:04.862799 bus /sierra_3: Setting Powered False 06:31:05.982262 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 06:31:07.069234 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.080612 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:07.124057 tst emergency_preemptive_call.py: using LAC 19584 06:31:07.237184 tst emergency_preemptive_call.py: using RAC 204 06:31:07.349137 tst emergency_preemptive_call.py: using CellId 19584 06:31:07.461732 tst emergency_preemptive_call.py: using BVCI 19585 06:31:07.568094 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.578739 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.589899 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.600687 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.611635 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 06:31:07.622614 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.740099 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.854308 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:07.966466 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:08.078474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:08.530082 run create_hlr_db(pid=2487): Launched 06:31:08.640462 bus /sierra_2: Setting Powered False 06:31:09.699034 run create_hlr_db(pid=2487): Terminated: ok {rc=0} 06:31:10.106137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Launched 06:31:10.396653 run osmo-hlr_10.42.42.2(pid=2490): Launched 06:31:10.507878 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:11.011506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Launched 06:31:11.301669 run osmo-stp_10.42.42.5(pid=2493): Launched 06:31:11.423853 tst emergency_preemptive_call.py: using MSISDN 7062 06:31:11.587356 run osmo-msc_10.42.42.6: Starting osmo-msc 06:31:12.109420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Launched 06:31:12.400112 run osmo-msc_10.42.42.6(pid=2496): Launched 06:31:12.563814 run osmo-stp_10.42.42.5(pid=2493): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] 06:31:12.689946 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-09_06:31:11.248396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:12.815095 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221209063111416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063111416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063111417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063111417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063111420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063111420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063111420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:12.937682 run osmo-stp_10.42.42.5(pid=2493): stdout: | (launched: 2022-12-09_06:31:11.248396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:13.053764 run osmo-stp_10.42.42.5(pid=2493): stderr: | 20221209063111416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063111416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063111417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063111417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063111420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063111420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063111420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:13.192625 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 06:31:13.201075 tst emergency_preemptive_call.py:32: Test FAILED (6.1 sec) 06:31:13.227831 run osmo-hlr_10.42.42.2(pid=2490): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2490)] 06:31:13.276520 run osmo-hlr_10.42.42.2(pid=2490): stdout: | (launched: 2022-12-09_06:31:10.343475) 06:31:13.326371 run osmo-hlr_10.42.42.2(pid=2490): stderr: | 20221209063110517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063110517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063110517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063110517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063110517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063110517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063110532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063110541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063110542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063110542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:13.397006 run osmo-msc_10.42.42.6(pid=2496): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2496)] 06:31:13.444779 run osmo-msc_10.42.42.6(pid=2496): stdout: | (launched: 2022-12-09_06:31:12.346771) 06:31:13.494504 run osmo-msc_10.42.42.6(pid=2496): stderr: | 20221209063112617 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063112617 DLGLOBAL DEBUG validating counter group 0x7f9a33ce2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063112617 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063112617 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063112617 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063112618 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063112619 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063112620 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063112620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063112620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:31:13.544348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminating (SIGTERM) 06:31:13.584809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminating (SIGTERM) 06:31:13.625661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Terminating (SIGTERM) 06:31:13.666702 --- ParallelTerminationStrategy: PID 2489 died... 06:31:13.686000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2489): Terminated: ok {rc=0} 06:31:13.731136 --- ParallelTerminationStrategy: PID 2492 died... 06:31:13.750151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2492): Terminated: ok {rc=0} 06:31:13.795668 --- ParallelTerminationStrategy: PID 2495 died... 06:31:13.814711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2495): Terminated: ok {rc=0} 06:31:13.902152 bus /sierra_9: Setting Powered False 06:31:15.002392 bus /sierra_9: Setting Powered False 06:31:16.132521 bus /sierra_8: Setting Powered False 06:31:17.234809 bus /sierra_8: Setting Powered False 06:31:18.353129 bus /sierra_3: Setting Powered False 06:31:19.451514 bus /sierra_3: Setting Powered False 06:31:20.567843 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900 --------------------------------------------------------------------- 06:31:21.836131 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:31:21.841333 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 06:31:21.864868 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 06:31:21.903754 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 06:31:21.988033 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 06:31:22.011067 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 06:31:22.048545 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 06:31:22.640106 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 06:31:22.688470 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:22.699019 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:22.737192 tst cs_paging_gprs_active.py: using LAC 19585 06:31:22.854839 tst cs_paging_gprs_active.py: using RAC 205 06:31:22.973415 tst cs_paging_gprs_active.py: using CellId 19585 06:31:23.094872 tst cs_paging_gprs_active.py: using BVCI 19586 06:31:23.203959 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.214589 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.225027 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.235649 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.246216 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.256726 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.267532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.278079 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:23.288682 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:23.406919 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:23.522151 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:31:23.720752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:24.018458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2501): Launched 06:31:24.277230 run iperf3-srv_10.42.42.10(pid=2502): Launched 06:31:24.389181 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:31:24.586514 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:24.884251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2503): Launched 06:31:25.142823 run iperf3-srv_10.42.42.10(pid=2504): Launched 06:31:25.254056 tst cs_paging_gprs_active.py:38: start network... 06:31:25.452006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:25.912190 run create_hlr_db(pid=2505): Launched 06:31:26.025449 bus /sierra_2: Setting Powered False 06:31:27.085185 run create_hlr_db(pid=2505): Terminated: ok {rc=0} 06:31:27.500129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Launched 06:31:27.796293 run osmo-hlr_10.42.42.2(pid=2508): Launched 06:31:27.909568 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:28.434920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Launched 06:31:28.731921 run osmo-stp_10.42.42.5(pid=2511): Launched 06:31:28.845516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:29.356546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2513): Launched 06:31:29.470346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:29.721172 run patchelf(pid=2514): Launched 06:31:29.885925 run osmo-stp_10.42.42.5(pid=2511): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] 06:31:30.012001 run osmo-stp_10.42.42.5(pid=2511): stdout: | (launched: 2022-12-09_06:31:28.677723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:30.139730 run osmo-stp_10.42.42.5(pid=2511): stderr: | 20221209063128845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063128845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063128845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063128846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063128846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063128846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063128846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:30.267388 run osmo-stp_10.42.42.5(pid=2511): stdout: | (launched: 2022-12-09_06:31:28.677723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:30.389369 run osmo-stp_10.42.42.5(pid=2511): stderr: | 20221209063128845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063128845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063128845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063128846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063128846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063128846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063128846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:30.533911 run patchelf(pid=2514): Terminating (SIGINT) 06:31:30.700920 run patchelf(pid=2514): Terminated: ok {rc=0} 06:31:30.821538 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2511): Process ended prematurely: osmo-stp_10.42.42.5(pid=2511) [trial-2355↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] [trial-2355↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 06:31:30.832731 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 06:31:30.867627 run osmo-hlr_10.42.42.2(pid=2508): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2508)] 06:31:30.928205 run osmo-hlr_10.42.42.2(pid=2508): stdout: | (launched: 2022-12-09_06:31:27.741870) 06:31:30.978431 run osmo-hlr_10.42.42.2(pid=2508): stderr: | 20221209063127915 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063127915 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063127915 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063127915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063127915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063127915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063127927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063127936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063127936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063127936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:31.029179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2501): Terminating (SIGTERM) 06:31:31.070205 run iperf3-srv_10.42.42.10(pid=2502): Terminating (SIGTERM) 06:31:31.112645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2503): Terminating (SIGTERM) 06:31:31.154224 run iperf3-srv_10.42.42.10(pid=2504): Terminating (SIGTERM) 06:31:31.195071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Terminating (SIGTERM) 06:31:31.236168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Terminating (SIGTERM) 06:31:31.277150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2513): Terminating (SIGTERM) 06:31:31.318124 --- ParallelTerminationStrategy: PID 2501 died... 06:31:31.337349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2501): Terminated: ok {rc=0} 06:31:31.382880 --- ParallelTerminationStrategy: PID 2502 died... 06:31:31.402198 run iperf3-srv_10.42.42.10(pid=2502): Terminated {rc=256} 06:31:31.447217 --- ParallelTerminationStrategy: PID 2503 died... 06:31:31.466352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2503): Terminated: ok {rc=0} 06:31:31.511571 --- ParallelTerminationStrategy: PID 2504 died... 06:31:31.530752 run iperf3-srv_10.42.42.10(pid=2504): Terminated {rc=256} 06:31:31.575790 --- ParallelTerminationStrategy: PID 2507 died... 06:31:31.594869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Terminated: ok {rc=0} 06:31:31.640153 --- ParallelTerminationStrategy: PID 2510 died... 06:31:31.659548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Terminated: ok {rc=0} 06:31:31.705193 --- ParallelTerminationStrategy: PID 2513 died... 06:31:31.724447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2513): Terminated: ok {rc=0} 06:31:31.810167 bus /gobi_0: Setting Powered False 06:31:32.905408 bus /gobi_0: Setting Powered False 06:31:34.020773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 06:31:35.168247 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.179777 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:35.219365 tst iperf3.py: using LAC 19586 06:31:35.348505 tst iperf3.py: using RAC 206 06:31:35.473309 tst iperf3.py: using CellId 19586 06:31:35.597332 tst iperf3.py: using BVCI 19587 06:31:35.713266 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.724273 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.735311 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.746345 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.757371 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.768149 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.779145 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.790045 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:35.801104 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:35.917669 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:31:36.131308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:36.449028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Launched 06:31:36.724752 run iperf3-srv_10.42.42.10(pid=2516): Launched 06:31:36.843709 tst iperf3.py:8: start network... 06:31:37.057701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:37.550773 run create_hlr_db(pid=2517): Launched 06:31:37.680760 bus /gobi_6: Setting Powered False 06:31:38.744275 run create_hlr_db(pid=2517): Terminated: ok {rc=0} 06:31:39.187275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Launched 06:31:39.505282 run osmo-hlr_10.42.42.2(pid=2520): Launched 06:31:39.627090 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:40.179079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Launched 06:31:40.496704 run osmo-stp_10.42.42.5(pid=2523): Launched 06:31:40.617985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:41.167271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Launched 06:31:41.289299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:41.558964 run patchelf(pid=2526): Launched 06:31:41.736834 run osmo-stp_10.42.42.5(pid=2523): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] 06:31:41.871839 run osmo-stp_10.42.42.5(pid=2523): stdout: | (launched: 2022-12-09_06:31:40.438607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:42.009080 run osmo-stp_10.42.42.5(pid=2523): stderr: | 20221209063140633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063140633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063140634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063140634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063140635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063140635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063140635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:42.145661 run osmo-stp_10.42.42.5(pid=2523): stdout: | (launched: 2022-12-09_06:31:40.438607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:42.277367 run osmo-stp_10.42.42.5(pid=2523): stderr: | 20221209063140633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063140633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063140634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063140634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063140635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063140635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063140635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:42.432895 run patchelf(pid=2526): Terminating (SIGINT) 06:31:42.612043 run patchelf(pid=2526): Terminated: ok {rc=0} 06:31:42.741284 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2523): Process ended prematurely: osmo-stp_10.42.42.5(pid=2523) [trial-2355↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] [trial-2355↪gprs:nanobts+band-1900↪iperf3.py:8] 06:31:42.751119 tst iperf3.py:8: Test FAILED (7.6 sec) 06:31:42.779571 run osmo-hlr_10.42.42.2(pid=2520): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2520)] 06:31:42.829393 run osmo-hlr_10.42.42.2(pid=2520): stdout: | (launched: 2022-12-09_06:31:39.447605) 06:31:42.881256 run osmo-hlr_10.42.42.2(pid=2520): stderr: | 20221209063139647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063139647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063139647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063139647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063139647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063139647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063139660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063139669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063139669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063139669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:42.933504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Terminating (SIGTERM) 06:31:42.975474 run iperf3-srv_10.42.42.10(pid=2516): Terminating (SIGTERM) 06:31:43.017271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Terminating (SIGTERM) 06:31:43.059103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Terminating (SIGTERM) 06:31:43.100799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Terminating (SIGTERM) 06:31:43.142845 --- ParallelTerminationStrategy: PID 2515 died... 06:31:43.162774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2515): Terminated: ok {rc=0} 06:31:43.209068 --- ParallelTerminationStrategy: PID 2516 died... 06:31:43.228530 run iperf3-srv_10.42.42.10(pid=2516): Terminated {rc=256} 06:31:43.274492 --- ParallelTerminationStrategy: PID 2519 died... 06:31:43.293944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2519): Terminated: ok {rc=0} 06:31:43.339869 --- ParallelTerminationStrategy: PID 2522 died... 06:31:43.359429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2522): Terminated: ok {rc=0} 06:31:43.405477 --- ParallelTerminationStrategy: PID 2525 died... 06:31:43.425054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2525): Terminated: ok {rc=0} 06:31:43.511732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 06:31:44.660368 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:44.671445 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:31:44.708425 tst iperf3m4.py: using LAC 19587 06:31:44.824782 tst iperf3m4.py: using RAC 207 06:31:44.941331 tst iperf3m4.py: using CellId 19587 06:31:45.059143 tst iperf3m4.py: using BVCI 19588 06:31:45.169195 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.179761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.190294 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.201362 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.212205 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.222751 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.233625 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.244174 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:31:45.254910 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:45.372364 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:45.490194 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:45.610275 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:31:45.728430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:31:45.963520 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:46.291560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Launched 06:31:46.587565 run iperf3-srv_10.42.42.10(pid=2528): Launched 06:31:46.722531 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:31:46.942256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:47.266484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2529): Launched 06:31:47.544453 run iperf3-srv_10.42.42.10(pid=2530): Launched 06:31:47.664500 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:31:47.878696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:48.198874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2531): Launched 06:31:48.475521 run iperf3-srv_10.42.42.10(pid=2532): Launched 06:31:48.594628 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:31:48.808432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:31:49.128811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2533): Launched 06:31:49.405201 run iperf3-srv_10.42.42.10(pid=2534): Launched 06:31:49.524296 tst iperf3m4.py:8: start network... 06:31:49.738736 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:31:50.232545 run create_hlr_db(pid=2535): Launched 06:31:50.361657 bus /gobi_6: Setting Powered False 06:31:51.424916 run create_hlr_db(pid=2535): Terminated: ok {rc=0} 06:31:51.869026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Launched 06:31:52.187547 run osmo-hlr_10.42.42.2(pid=2538): Launched 06:31:52.309210 run osmo-stp_10.42.42.5: Starting osmo-stp 06:31:52.861135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Launched 06:31:53.178832 run osmo-stp_10.42.42.5(pid=2541): Launched 06:31:53.299569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:31:53.850053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2543): Launched 06:31:53.972407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:31:54.242381 run patchelf(pid=2544): Launched 06:31:54.421603 run osmo-stp_10.42.42.5(pid=2541): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] 06:31:54.556493 run osmo-stp_10.42.42.5(pid=2541): stdout: | (launched: 2022-12-09_06:31:53.121142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:54.692723 run osmo-stp_10.42.42.5(pid=2541): stderr: | 20221209063153310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063153310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063153311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063153311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063153311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063153312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063153312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:54.829429 run osmo-stp_10.42.42.5(pid=2541): stdout: | (launched: 2022-12-09_06:31:53.121142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:31:54.961249 run osmo-stp_10.42.42.5(pid=2541): stderr: | 20221209063153310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063153310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063153311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063153311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063153311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063153312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063153312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:31:55.116892 run patchelf(pid=2544): Terminating (SIGINT) 06:31:55.295802 run patchelf(pid=2544): Terminated: ok {rc=0} 06:31:55.424364 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2541): Process ended prematurely: osmo-stp_10.42.42.5(pid=2541) [trial-2355↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] [trial-2355↪gprs:nanobts+band-1900↪iperf3m4.py:8] 06:31:55.434393 tst iperf3m4.py:8: Test FAILED (10.8 sec) 06:31:55.462663 run osmo-hlr_10.42.42.2(pid=2538): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2538)] 06:31:55.512618 run osmo-hlr_10.42.42.2(pid=2538): stdout: | (launched: 2022-12-09_06:31:52.129461) 06:31:55.563969 run osmo-hlr_10.42.42.2(pid=2538): stderr: | 20221209063152327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063152327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063152327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063152327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063152327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063152327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063152339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063152348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063152348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063152348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:31:55.615859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Terminating (SIGTERM) 06:31:55.657405 run iperf3-srv_10.42.42.10(pid=2528): Terminating (SIGTERM) 06:31:55.698995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2529): Terminating (SIGTERM) 06:31:55.740743 run iperf3-srv_10.42.42.10(pid=2530): Terminating (SIGTERM) 06:31:55.782296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2531): Terminating (SIGTERM) 06:31:55.823738 run iperf3-srv_10.42.42.10(pid=2532): Terminating (SIGTERM) 06:31:55.865506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2533): Terminating (SIGTERM) 06:31:55.907194 run iperf3-srv_10.42.42.10(pid=2534): Terminating (SIGTERM) 06:31:55.948382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Terminating (SIGTERM) 06:31:55.989931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Terminating (SIGTERM) 06:31:56.031891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2543): Terminating (SIGTERM) 06:31:56.073821 --- ParallelTerminationStrategy: PID 2527 died... 06:31:56.093705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2527): Terminated: ok {rc=0} 06:31:56.139560 --- ParallelTerminationStrategy: PID 2528 died... 06:31:56.158936 run iperf3-srv_10.42.42.10(pid=2528): Terminated {rc=256} 06:31:56.204476 --- ParallelTerminationStrategy: PID 2529 died... 06:31:56.223850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2529): Terminated: ok {rc=0} 06:31:56.269539 --- ParallelTerminationStrategy: PID 2530 died... 06:31:56.288659 run iperf3-srv_10.42.42.10(pid=2530): Terminated {rc=256} 06:31:56.334363 --- ParallelTerminationStrategy: PID 2531 died... 06:31:56.353527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2531): Terminated: ok {rc=0} 06:31:56.399076 --- ParallelTerminationStrategy: PID 2532 died... 06:31:56.418386 run iperf3-srv_10.42.42.10(pid=2532): Terminated {rc=256} 06:31:56.463789 --- ParallelTerminationStrategy: PID 2533 died... 06:31:56.483226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2533): Terminated: ok {rc=0} 06:31:56.529168 --- ParallelTerminationStrategy: PID 2534 died... 06:31:56.548362 run iperf3-srv_10.42.42.10(pid=2534): Terminated {rc=256} 06:31:56.594071 --- ParallelTerminationStrategy: PID 2537 died... 06:31:56.613476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Terminated: ok {rc=0} 06:31:56.658928 --- ParallelTerminationStrategy: PID 2540 died... 06:31:56.678328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Terminated: ok {rc=0} 06:31:56.723729 --- ParallelTerminationStrategy: PID 2543 died... 06:31:56.743151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2543): Terminated: ok {rc=0} 06:31:56.830689 bus /gobi_4: Setting Powered False 06:31:57.930859 bus /gobi_4: Setting Powered False 06:31:59.045383 bus /gobi_1: Setting Powered False 06:32:00.144261 bus /gobi_1: Setting Powered False 06:32:01.264539 bus /gobi_0: Setting Powered False 06:32:02.362449 bus /gobi_0: Setting Powered False 06:32:03.483559 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 06:32:04.585829 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:04.597508 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:04.637391 tst ping.py: using LAC 19588 06:32:04.752321 tst ping.py: using RAC 208 06:32:04.866316 tst ping.py: using CellId 19588 06:32:04.980229 tst ping.py: using BVCI 19589 06:32:05.085264 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.095758 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.106354 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.117142 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.127859 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.138481 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.149198 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:05.159828 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:05.270762 tst ping.py:19: start network... 06:32:05.463737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:05.914759 run create_hlr_db(pid=2545): Launched 06:32:06.024605 bus /gobi_6: Setting Powered False 06:32:07.083396 run create_hlr_db(pid=2545): Terminated: ok {rc=0} 06:32:07.489306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2547): Launched 06:32:07.779340 run osmo-hlr_10.42.42.2(pid=2548): Launched 06:32:07.890083 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:08.390126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2550): Launched 06:32:08.680623 run osmo-stp_10.42.42.5(pid=2551): Launched 06:32:08.791323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:09.293354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2553): Launched 06:32:09.405404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:09.652340 run patchelf(pid=2554): Launched 06:32:09.816013 run osmo-stp_10.42.42.5(pid=2551): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2551)] 06:32:09.940290 run osmo-stp_10.42.42.5(pid=2551): stdout: | (launched: 2022-12-09_06:32:08.627243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:10.065933 run osmo-stp_10.42.42.5(pid=2551): stderr: | 20221209063208795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063208795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063208795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063208796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063208796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063208796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063208796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:10.191472 run osmo-stp_10.42.42.5(pid=2551): stdout: | (launched: 2022-12-09_06:32:08.627243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:10.311086 run osmo-stp_10.42.42.5(pid=2551): stderr: | 20221209063208795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063208795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063208795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063208796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063208796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063208796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063208796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:10.452691 run patchelf(pid=2554): Terminating (SIGINT) 06:32:10.617109 run patchelf(pid=2554): Terminated: ok {rc=0} 06:32:10.735806 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2551): Process ended prematurely: osmo-stp_10.42.42.5(pid=2551) [trial-2355↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2551)] [trial-2355↪gprs:nanobts+band-1900↪ping.py:22] 06:32:10.744476 tst ping.py:22: Test FAILED (6.2 sec) 06:32:10.771596 run osmo-hlr_10.42.42.2(pid=2548): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2548)] 06:32:10.819221 run osmo-hlr_10.42.42.2(pid=2548): stdout: | (launched: 2022-12-09_06:32:07.726537) 06:32:10.869307 run osmo-hlr_10.42.42.2(pid=2548): stderr: | 20221209063207899 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063207899 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063207899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063207899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063207899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063207899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063207911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063207920 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063207920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063207920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:10.919144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2547): Terminating (SIGTERM) 06:32:10.958902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2550): Terminating (SIGTERM) 06:32:10.998471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2553): Terminating (SIGTERM) 06:32:11.039126 --- ParallelTerminationStrategy: PID 2547 died... 06:32:11.058149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2547): Terminated: ok {rc=0} 06:32:11.102489 --- ParallelTerminationStrategy: PID 2550 died... 06:32:11.121248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2550): Terminated: ok {rc=0} 06:32:11.165644 --- ParallelTerminationStrategy: PID 2553 died... 06:32:11.184313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2553): Terminated: ok {rc=0} 06:32:11.267898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 06:32:12.352026 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.363220 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 06:32:12.402913 tst ping_idle_ping.py: using LAC 19589 06:32:12.526501 tst ping_idle_ping.py: using RAC 209 06:32:12.648784 tst ping_idle_ping.py: using CellId 19589 06:32:12.771159 tst ping_idle_ping.py: using BVCI 19590 06:32:12.884130 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.895218 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.906468 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.917849 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.928687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.939643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.950694 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 06:32:12.961699 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 06:32:13.074365 tst ping_idle_ping.py:24: start network... 06:32:13.269060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:13.722069 run create_hlr_db(pid=2555): Launched 06:32:13.833875 bus /gobi_6: Setting Powered False 06:32:14.896212 run create_hlr_db(pid=2555): Terminated: ok {rc=0} 06:32:15.316522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2557): Launched 06:32:15.608158 run osmo-hlr_10.42.42.2(pid=2558): Launched 06:32:15.719255 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:16.319189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2560): Launched 06:32:16.670428 run osmo-stp_10.42.42.5(pid=2561): Launched 06:32:16.942856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:17.491035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2563): Launched 06:32:17.612150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:17.877551 run patchelf(pid=2564): Launched 06:32:18.053951 run osmo-stp_10.42.42.5(pid=2561): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2561)] 06:32:18.187708 run osmo-stp_10.42.42.5(pid=2561): stdout: | (launched: 2022-12-09_06:32:16.602952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:18.323079 run osmo-stp_10.42.42.5(pid=2561): stderr: | 20221209063216797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063216797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063216798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063216798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063216798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063216799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063216799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:18.458791 run osmo-stp_10.42.42.5(pid=2561): stdout: | (launched: 2022-12-09_06:32:16.602952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:18.588282 run osmo-stp_10.42.42.5(pid=2561): stderr: | 20221209063216797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063216797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063216798 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063216798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063216798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063216799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063216799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:18.741733 run patchelf(pid=2564): Terminating (SIGINT) 06:32:18.919025 run patchelf(pid=2564): Terminated: ok {rc=0} 06:32:19.046397 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2561): Process ended prematurely: osmo-stp_10.42.42.5(pid=2561) [trial-2355↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2561)] [trial-2355↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 06:32:19.055817 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 06:32:19.083893 run osmo-hlr_10.42.42.2(pid=2558): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2558)] 06:32:19.133900 run osmo-hlr_10.42.42.2(pid=2558): stdout: | (launched: 2022-12-09_06:32:15.554654) 06:32:19.185569 run osmo-hlr_10.42.42.2(pid=2558): stderr: | 20221209063215729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063215729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063215729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063215729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063215729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063215729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063215742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063215752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063215753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063215753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:19.237747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2557): Terminating (SIGTERM) 06:32:19.279862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2560): Terminating (SIGTERM) 06:32:19.322402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2563): Terminating (SIGTERM) 06:32:19.364834 --- ParallelTerminationStrategy: PID 2557 died... 06:32:19.384893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2557): Terminated: ok {rc=0} 06:32:19.431627 --- ParallelTerminationStrategy: PID 2560 died... 06:32:19.451341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2560): Terminated: ok {rc=0} 06:32:19.497648 --- ParallelTerminationStrategy: PID 2563 died... 06:32:19.517449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2563): Terminated: ok {rc=0} 06:32:19.605214 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 06:32:20.906232 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:32:20.913155 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:32:20.937962 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:32:20.977045 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:32:21.064587 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:32:21.088594 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:32:21.127431 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:32:21.724637 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:32:21.775428 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:21.786771 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:21.828271 tst cs_paging_gprs_active.py: using LAC 19590 06:32:21.955538 tst cs_paging_gprs_active.py: using RAC 210 06:32:22.082004 tst cs_paging_gprs_active.py: using CellId 19590 06:32:22.208338 tst cs_paging_gprs_active.py: using BVCI 19591 06:32:22.323881 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.335177 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.346235 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.357376 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.368362 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.379364 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.390604 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.401705 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:22.412813 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:22.527086 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:22.646721 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:32:22.860558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:23.178846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2569): Launched 06:32:23.455030 run iperf3-srv_10.42.42.10(pid=2570): Launched 06:32:23.574120 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:32:23.788060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:24.107185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2571): Launched 06:32:24.383622 run iperf3-srv_10.42.42.10(pid=2572): Launched 06:32:24.502872 tst cs_paging_gprs_active.py:38: start network... 06:32:24.716376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:25.209659 run create_hlr_db(pid=2573): Launched 06:32:25.338639 bus /gobi_6: Setting Powered False 06:32:26.402111 run create_hlr_db(pid=2573): Terminated: ok {rc=0} 06:32:26.825853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Launched 06:32:27.122705 run osmo-hlr_10.42.42.2(pid=2576): Launched 06:32:27.235767 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:27.746801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Launched 06:32:28.045180 run osmo-stp_10.42.42.5(pid=2579): Launched 06:32:28.158617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:28.671921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2581): Launched 06:32:28.786069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:29.037144 run patchelf(pid=2582): Launched 06:32:29.202904 run osmo-stp_10.42.42.5(pid=2579): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] 06:32:29.329694 run osmo-stp_10.42.42.5(pid=2579): stdout: | (launched: 2022-12-09_06:32:27.990933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:29.457824 run osmo-stp_10.42.42.5(pid=2579): stderr: | 20221209063228158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063228159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063228159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063228159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063228160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063228160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063228160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:29.586077 run osmo-stp_10.42.42.5(pid=2579): stdout: | (launched: 2022-12-09_06:32:27.990933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:29.708610 run osmo-stp_10.42.42.5(pid=2579): stderr: | 20221209063228158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063228159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063228159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063228159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063228160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063228160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063228160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:29.854199 run patchelf(pid=2582): Terminating (SIGINT) 06:32:30.023153 run patchelf(pid=2582): Terminated: ok {rc=0} 06:32:30.144704 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2579): Process ended prematurely: osmo-stp_10.42.42.5(pid=2579) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:32:30.154080 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:32:30.181372 run osmo-hlr_10.42.42.2(pid=2576): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2576)] 06:32:30.230263 run osmo-hlr_10.42.42.2(pid=2576): stdout: | (launched: 2022-12-09_06:32:27.068523) 06:32:30.279731 run osmo-hlr_10.42.42.2(pid=2576): stderr: | 20221209063227245 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063227245 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063227245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063227245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063227245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063227245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063227258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063227266 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063227266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063227266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:30.329592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2569): Terminating (SIGTERM) 06:32:30.369654 run iperf3-srv_10.42.42.10(pid=2570): Terminating (SIGTERM) 06:32:30.409324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2571): Terminating (SIGTERM) 06:32:30.449410 run iperf3-srv_10.42.42.10(pid=2572): Terminating (SIGTERM) 06:32:30.489121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Terminating (SIGTERM) 06:32:30.529039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Terminating (SIGTERM) 06:32:30.568731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2581): Terminating (SIGTERM) 06:32:30.608643 --- ParallelTerminationStrategy: PID 2569 died... 06:32:30.627776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2569): Terminated: ok {rc=0} 06:32:30.672330 --- ParallelTerminationStrategy: PID 2570 died... 06:32:30.691133 run iperf3-srv_10.42.42.10(pid=2570): Terminated {rc=256} 06:32:30.735209 --- ParallelTerminationStrategy: PID 2571 died... 06:32:30.753831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2571): Terminated: ok {rc=0} 06:32:30.798029 --- ParallelTerminationStrategy: PID 2572 died... 06:32:30.816650 run iperf3-srv_10.42.42.10(pid=2572): Terminated {rc=256} 06:32:30.883707 --- ParallelTerminationStrategy: PID 2575 died... 06:32:30.904288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2575): Terminated: ok {rc=0} 06:32:30.954254 --- ParallelTerminationStrategy: PID 2578 died... 06:32:30.975100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2578): Terminated: ok {rc=0} 06:32:31.025398 --- ParallelTerminationStrategy: PID 2581 died... 06:32:31.045796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2581): Terminated: ok {rc=0} 06:32:31.137631 bus /gobi_0: Setting Powered False 06:32:32.243444 bus /gobi_0: Setting Powered False 06:32:33.358799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:32:34.500461 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:34.511974 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:34.556174 tst iperf3.py: using LAC 19591 06:32:34.674760 tst iperf3.py: using RAC 211 06:32:34.791429 tst iperf3.py: using CellId 19591 06:32:34.907862 tst iperf3.py: using BVCI 19592 06:32:35.017253 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.027985 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.038587 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.049581 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.060651 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.071652 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.082804 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.093778 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:35.104724 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:35.221944 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:32:35.437553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:35.756700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2585): Launched 06:32:36.033811 run iperf3-srv_10.42.42.10(pid=2589): Launched 06:32:36.152915 tst iperf3.py:8: start network... 06:32:36.367075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:36.861301 run create_hlr_db(pid=2590): Launched 06:32:36.991632 bus /gobi_6: Setting Powered False 06:32:38.054830 run create_hlr_db(pid=2590): Terminated: ok {rc=0} 06:32:38.478925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2592): Launched 06:32:38.775253 run osmo-hlr_10.42.42.2(pid=2593): Launched 06:32:38.888367 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:39.415336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2595): Launched 06:32:39.712117 run osmo-stp_10.42.42.5(pid=2596): Launched 06:32:39.825179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:40.336292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2598): Launched 06:32:40.450188 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:40.701635 run patchelf(pid=2599): Launched 06:32:40.867065 run osmo-stp_10.42.42.5(pid=2596): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2596)] 06:32:40.993701 run osmo-stp_10.42.42.5(pid=2596): stdout: | (launched: 2022-12-09_06:32:39.657729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:41.121766 run osmo-stp_10.42.42.5(pid=2596): stderr: | 20221209063239827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063239827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063239828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063239828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063239828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063239829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063239829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:41.249655 run osmo-stp_10.42.42.5(pid=2596): stdout: | (launched: 2022-12-09_06:32:39.657729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:41.372454 run osmo-stp_10.42.42.5(pid=2596): stderr: | 20221209063239827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063239827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063239828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063239828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063239828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063239829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063239829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:41.517897 run patchelf(pid=2599): Terminating (SIGINT) 06:32:41.685212 run patchelf(pid=2599): Terminated: ok {rc=0} 06:32:41.806063 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2596): Process ended prematurely: osmo-stp_10.42.42.5(pid=2596) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2596)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 06:32:41.815287 tst iperf3.py:8: Test FAILED (7.4 sec) 06:32:41.842708 run osmo-hlr_10.42.42.2(pid=2593): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2593)] 06:32:41.890413 run osmo-hlr_10.42.42.2(pid=2593): stdout: | (launched: 2022-12-09_06:32:38.721200) 06:32:41.939635 run osmo-hlr_10.42.42.2(pid=2593): stderr: | 20221209063238897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063238897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063238897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063238897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063238897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063238898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063238910 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063238918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063238919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063238919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:41.989389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2585): Terminating (SIGTERM) 06:32:42.029365 run iperf3-srv_10.42.42.10(pid=2589): Terminating (SIGTERM) 06:32:42.069479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2592): Terminating (SIGTERM) 06:32:42.109617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2595): Terminating (SIGTERM) 06:32:42.149278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2598): Terminating (SIGTERM) 06:32:42.190134 --- ParallelTerminationStrategy: PID 2585 died... 06:32:42.209303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2585): Terminated: ok {rc=0} 06:32:42.254295 --- ParallelTerminationStrategy: PID 2589 died... 06:32:42.272911 run iperf3-srv_10.42.42.10(pid=2589): Terminated {rc=256} 06:32:42.317479 --- ParallelTerminationStrategy: PID 2592 died... 06:32:42.336069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2592): Terminated: ok {rc=0} 06:32:42.380377 --- ParallelTerminationStrategy: PID 2595 died... 06:32:42.399078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2595): Terminated: ok {rc=0} 06:32:42.443333 --- ParallelTerminationStrategy: PID 2598 died... 06:32:42.461996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2598): Terminated: ok {rc=0} 06:32:42.545746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:32:43.694029 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:43.705924 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:32:43.747861 tst iperf3m4.py: using LAC 19592 06:32:43.875492 tst iperf3m4.py: using RAC 212 06:32:44.004178 tst iperf3m4.py: using CellId 19592 06:32:44.120938 tst iperf3m4.py: using BVCI 19593 06:32:44.228777 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.239745 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.250360 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.261364 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.272216 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.282956 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.293990 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.304847 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:32:44.315808 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:44.434806 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:44.553107 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:44.670676 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:32:44.788125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:32:45.004120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:45.323158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2600): Launched 06:32:45.601299 run iperf3-srv_10.42.42.10(pid=2601): Launched 06:32:45.720798 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:32:45.959964 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:46.291750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2602): Launched 06:32:46.606822 run iperf3-srv_10.42.42.10(pid=2603): Launched 06:32:46.777597 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:32:46.991215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:47.306887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2604): Launched 06:32:47.595293 run iperf3-srv_10.42.42.10(pid=2605): Launched 06:32:47.715072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:32:47.929438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:32:48.248809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2606): Launched 06:32:48.524887 run iperf3-srv_10.42.42.10(pid=2607): Launched 06:32:48.643392 tst iperf3m4.py:8: start network... 06:32:48.856628 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:32:49.350549 run create_hlr_db(pid=2608): Launched 06:32:49.478245 bus /gobi_6: Setting Powered False 06:32:50.541795 run create_hlr_db(pid=2608): Terminated: ok {rc=0} 06:32:50.965140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2610): Launched 06:32:51.284362 run osmo-hlr_10.42.42.2(pid=2611): Launched 06:32:51.404153 run osmo-stp_10.42.42.5: Starting osmo-stp 06:32:51.956468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2613): Launched 06:32:52.274981 run osmo-stp_10.42.42.5(pid=2614): Launched 06:32:52.395055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:32:52.942909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2616): Launched 06:32:53.064922 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:32:53.333821 run patchelf(pid=2617): Launched 06:32:53.510254 run osmo-stp_10.42.42.5(pid=2614): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2614)] 06:32:53.645343 run osmo-stp_10.42.42.5(pid=2614): stdout: | (launched: 2022-12-09_06:32:52.217142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:53.781768 run osmo-stp_10.42.42.5(pid=2614): stderr: | 20221209063252406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063252406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063252407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063252407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063252408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063252408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063252408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:53.918120 run osmo-stp_10.42.42.5(pid=2614): stdout: | (launched: 2022-12-09_06:32:52.217142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:32:54.050099 run osmo-stp_10.42.42.5(pid=2614): stderr: | 20221209063252406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063252406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063252407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063252407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063252408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063252408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063252408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:32:54.206041 run patchelf(pid=2617): Terminating (SIGINT) 06:32:54.385291 run patchelf(pid=2617): Terminated: ok {rc=0} 06:32:54.513986 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2614): Process ended prematurely: osmo-stp_10.42.42.5(pid=2614) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2614)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 06:32:54.523927 tst iperf3m4.py:8: Test FAILED (10.9 sec) 06:32:54.552489 run osmo-hlr_10.42.42.2(pid=2611): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2611)] 06:32:54.602312 run osmo-hlr_10.42.42.2(pid=2611): stdout: | (launched: 2022-12-09_06:32:51.226499) 06:32:54.653745 run osmo-hlr_10.42.42.2(pid=2611): stderr: | 20221209063251423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063251423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063251423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063251423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063251423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063251423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063251435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063251445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063251446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063251446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:32:54.705619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2600): Terminating (SIGTERM) 06:32:54.747493 run iperf3-srv_10.42.42.10(pid=2601): Terminating (SIGTERM) 06:32:54.789081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2602): Terminating (SIGTERM) 06:32:54.830726 run iperf3-srv_10.42.42.10(pid=2603): Terminating (SIGTERM) 06:32:54.872195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2604): Terminating (SIGTERM) 06:32:54.913922 run iperf3-srv_10.42.42.10(pid=2605): Terminating (SIGTERM) 06:32:54.955804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2606): Terminating (SIGTERM) 06:32:54.997824 run iperf3-srv_10.42.42.10(pid=2607): Terminating (SIGTERM) 06:32:55.039281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2610): Terminating (SIGTERM) 06:32:55.081063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2613): Terminating (SIGTERM) 06:32:55.122701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2616): Terminating (SIGTERM) 06:32:55.164870 --- ParallelTerminationStrategy: PID 2600 died... 06:32:55.185211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2600): Terminated: ok {rc=0} 06:32:55.231468 --- ParallelTerminationStrategy: PID 2601 died... 06:32:55.250992 run iperf3-srv_10.42.42.10(pid=2601): Terminated {rc=256} 06:32:55.296794 --- ParallelTerminationStrategy: PID 2602 died... 06:32:55.316769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2602): Terminated: ok {rc=0} 06:32:55.362506 --- ParallelTerminationStrategy: PID 2603 died... 06:32:55.381863 run iperf3-srv_10.42.42.10(pid=2603): Terminated {rc=256} 06:32:55.427405 --- ParallelTerminationStrategy: PID 2604 died... 06:32:55.446858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2604): Terminated: ok {rc=0} 06:32:55.492666 --- ParallelTerminationStrategy: PID 2605 died... 06:32:55.512175 run iperf3-srv_10.42.42.10(pid=2605): Terminated {rc=256} 06:32:55.557897 --- ParallelTerminationStrategy: PID 2606 died... 06:32:55.577462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2606): Terminated: ok {rc=0} 06:32:55.623351 --- ParallelTerminationStrategy: PID 2607 died... 06:32:55.642738 run iperf3-srv_10.42.42.10(pid=2607): Terminated {rc=256} 06:32:55.688457 --- ParallelTerminationStrategy: PID 2610 died... 06:32:55.708039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2610): Terminated: ok {rc=0} 06:32:55.753843 --- ParallelTerminationStrategy: PID 2613 died... 06:32:55.773368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2613): Terminated: ok {rc=0} 06:32:55.819255 --- ParallelTerminationStrategy: PID 2616 died... 06:32:55.838925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2616): Terminated: ok {rc=0} 06:32:55.926685 bus /gobi_4: Setting Powered False 06:32:57.025746 bus /gobi_4: Setting Powered False 06:32:58.141815 bus /gobi_1: Setting Powered False 06:32:59.241180 bus /gobi_1: Setting Powered False 06:33:00.357083 bus /gobi_0: Setting Powered False 06:33:01.456861 bus /gobi_0: Setting Powered False 06:33:02.575936 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 06:33:03.681222 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:03.692484 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:33:03.732524 tst ping.py: using LAC 19593 06:33:03.850549 tst ping.py: using RAC 213 06:33:03.968220 tst ping.py: using CellId 19593 06:33:04.085371 tst ping.py: using BVCI 19594 06:33:04.191872 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.202716 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.213467 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.224358 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.235464 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.246299 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.257502 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:04.268264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:33:04.380459 tst ping.py:19: start network... 06:33:04.574636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:05.024933 run create_hlr_db(pid=2619): Launched 06:33:05.135600 bus /gobi_6: Setting Powered False 06:33:06.194295 run create_hlr_db(pid=2619): Terminated: ok {rc=0} 06:33:06.603446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2621): Launched 06:33:06.894212 run osmo-hlr_10.42.42.2(pid=2622): Launched 06:33:07.004083 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:07.518259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2624): Launched 06:33:07.808858 run osmo-stp_10.42.42.5(pid=2625): Launched 06:33:07.920276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:08.438134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2627): Launched 06:33:08.549661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:08.795467 run patchelf(pid=2628): Launched 06:33:08.958831 run osmo-stp_10.42.42.5(pid=2625): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2625)] 06:33:09.083116 run osmo-stp_10.42.42.5(pid=2625): stdout: | (launched: 2022-12-09_06:33:07.755693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:09.209355 run osmo-stp_10.42.42.5(pid=2625): stderr: | 20221209063307923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063307923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063307924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063307924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063307925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063307925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063307925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:09.334950 run osmo-stp_10.42.42.5(pid=2625): stdout: | (launched: 2022-12-09_06:33:07.755693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:09.454548 run osmo-stp_10.42.42.5(pid=2625): stderr: | 20221209063307923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063307923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063307924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063307924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063307925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063307925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063307925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:09.596049 run patchelf(pid=2628): Terminating (SIGINT) 06:33:09.760172 run patchelf(pid=2628): Terminated: ok {rc=0} 06:33:09.878958 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2625): Process ended prematurely: osmo-stp_10.42.42.5(pid=2625) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2625)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 06:33:09.887575 tst ping.py:22: Test FAILED (6.2 sec) 06:33:09.914436 run osmo-hlr_10.42.42.2(pid=2622): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2622)] 06:33:09.962409 run osmo-hlr_10.42.42.2(pid=2622): stdout: | (launched: 2022-12-09_06:33:06.840720) 06:33:10.012000 run osmo-hlr_10.42.42.2(pid=2622): stderr: | 20221209063307014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063307014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063307014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063307014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063307014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063307014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063307026 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063307034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063307035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063307035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:10.062063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2621): Terminating (SIGTERM) 06:33:10.102007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2624): Terminating (SIGTERM) 06:33:10.141997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2627): Terminating (SIGTERM) 06:33:10.182224 --- ParallelTerminationStrategy: PID 2621 died... 06:33:10.201242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2621): Terminated: ok {rc=0} 06:33:10.245459 --- ParallelTerminationStrategy: PID 2624 died... 06:33:10.263881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2624): Terminated: ok {rc=0} 06:33:10.308112 --- ParallelTerminationStrategy: PID 2627 died... 06:33:10.326652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2627): Terminated: ok {rc=0} 06:33:10.412059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:33:11.500911 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:11.512887 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:33:11.555602 tst ping_idle_ping.py: using LAC 19594 06:33:11.670461 tst ping_idle_ping.py: using RAC 214 06:33:11.794857 tst ping_idle_ping.py: using CellId 19594 06:33:11.919558 tst ping_idle_ping.py: using BVCI 19595 06:33:12.034382 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.045984 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.057329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.069287 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.081179 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.092890 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.105165 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:33:12.118260 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:33:12.235733 tst ping_idle_ping.py:24: start network... 06:33:12.447131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:12.937731 run create_hlr_db(pid=2629): Launched 06:33:13.065428 bus /gobi_6: Setting Powered False 06:33:14.128427 run create_hlr_db(pid=2629): Terminated: ok {rc=0} 06:33:14.548490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2631): Launched 06:33:14.839644 run osmo-hlr_10.42.42.2(pid=2632): Launched 06:33:14.950543 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:15.466711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2634): Launched 06:33:15.757309 run osmo-stp_10.42.42.5(pid=2635): Launched 06:33:15.946106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:16.508606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2637): Launched 06:33:16.625608 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:16.882964 run patchelf(pid=2638): Launched 06:33:17.071097 run osmo-stp_10.42.42.5(pid=2635): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2635)] 06:33:17.198475 run osmo-stp_10.42.42.5(pid=2635): stdout: | (launched: 2022-12-09_06:33:15.704139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:17.326199 run osmo-stp_10.42.42.5(pid=2635): stderr: | 20221209063315881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063315881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063315882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063315882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063315885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063315885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063315885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:17.452174 run osmo-stp_10.42.42.5(pid=2635): stdout: | (launched: 2022-12-09_06:33:15.704139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:17.572274 run osmo-stp_10.42.42.5(pid=2635): stderr: | 20221209063315881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063315881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063315882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063315882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063315885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063315885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063315885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:17.713917 run patchelf(pid=2638): Terminating (SIGINT) 06:33:17.878442 run patchelf(pid=2638): Terminated: ok {rc=0} 06:33:17.997318 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2635): Process ended prematurely: osmo-stp_10.42.42.5(pid=2635) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2635)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:33:18.006249 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:33:18.033163 run osmo-hlr_10.42.42.2(pid=2632): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2632)] 06:33:18.081398 run osmo-hlr_10.42.42.2(pid=2632): stdout: | (launched: 2022-12-09_06:33:14.786566) 06:33:18.131141 run osmo-hlr_10.42.42.2(pid=2632): stderr: | 20221209063314961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063314961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063314961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063314961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063314961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063314961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063314973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063314981 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063314982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063314982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:18.181394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2631): Terminating (SIGTERM) 06:33:18.221400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2634): Terminating (SIGTERM) 06:33:18.261459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2637): Terminating (SIGTERM) 06:33:18.301758 --- ParallelTerminationStrategy: PID 2631 died... 06:33:18.320782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2631): Terminated: ok {rc=0} 06:33:18.365586 --- ParallelTerminationStrategy: PID 2634 died... 06:33:18.384172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2634): Terminated: ok {rc=0} 06:33:18.428447 --- ParallelTerminationStrategy: PID 2637 died... 06:33:18.447132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2637): Terminated: ok {rc=0} 06:33:18.532567 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:33:19.822422 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:33:19.829093 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:33:19.853324 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:33:19.891227 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:33:19.975281 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:33:19.998321 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:33:20.036099 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:33:20.632173 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:33:20.680254 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:20.691106 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:20.749820 tst cs_paging_gprs_active.py: using LAC 19595 06:33:20.867210 tst cs_paging_gprs_active.py: using RAC 215 06:33:20.985254 tst cs_paging_gprs_active.py: using CellId 19595 06:33:21.104156 tst cs_paging_gprs_active.py: using BVCI 19596 06:33:21.211612 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.222460 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.233158 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.244373 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.255274 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.266225 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.277336 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.288029 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:21.298998 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:21.417736 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:21.533578 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:33:21.730943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:22.027462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2642): Launched 06:33:22.285259 run iperf3-srv_10.42.42.10(pid=2643): Launched 06:33:22.396690 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:33:22.594521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:22.891379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2644): Launched 06:33:23.148850 run iperf3-srv_10.42.42.10(pid=2645): Launched 06:33:23.260584 tst cs_paging_gprs_active.py:38: start network... 06:33:23.457969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:23.918701 run create_hlr_db(pid=2646): Launched 06:33:24.031683 bus /gobi_6: Setting Powered False 06:33:25.090931 run create_hlr_db(pid=2646): Terminated: ok {rc=0} 06:33:25.527404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Launched 06:33:25.847661 run osmo-hlr_10.42.42.2(pid=2649): Launched 06:33:25.969802 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:26.523389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Launched 06:33:26.840602 run osmo-stp_10.42.42.5(pid=2652): Launched 06:33:26.961907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:27.509455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2654): Launched 06:33:27.630882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:27.899437 run patchelf(pid=2655): Launched 06:33:28.076362 run osmo-stp_10.42.42.5(pid=2652): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] 06:33:28.211307 run osmo-stp_10.42.42.5(pid=2652): stdout: | (launched: 2022-12-09_06:33:26.782858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:28.347829 run osmo-stp_10.42.42.5(pid=2652): stderr: | 20221209063326973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063326973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063326973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063326974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063326974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063326974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063326974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:28.484764 run osmo-stp_10.42.42.5(pid=2652): stdout: | (launched: 2022-12-09_06:33:26.782858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:28.615473 run osmo-stp_10.42.42.5(pid=2652): stderr: | 20221209063326973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063326973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063326973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063326974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063326974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063326974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063326974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:28.770386 run patchelf(pid=2655): Terminating (SIGINT) 06:33:28.948881 run patchelf(pid=2655): Terminated: ok {rc=0} 06:33:29.077816 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2652): Process ended prematurely: osmo-stp_10.42.42.5(pid=2652) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:33:29.087737 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 06:33:29.116230 run osmo-hlr_10.42.42.2(pid=2649): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2649)] 06:33:29.166020 run osmo-hlr_10.42.42.2(pid=2649): stdout: | (launched: 2022-12-09_06:33:25.789482) 06:33:29.217698 run osmo-hlr_10.42.42.2(pid=2649): stderr: | 20221209063325986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063325986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063325986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063325986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063325986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063325986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063326002 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063326012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063326013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063326013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:29.269887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2642): Terminating (SIGTERM) 06:33:29.311854 run iperf3-srv_10.42.42.10(pid=2643): Terminating (SIGTERM) 06:33:29.353945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2644): Terminating (SIGTERM) 06:33:29.395965 run iperf3-srv_10.42.42.10(pid=2645): Terminating (SIGTERM) 06:33:29.437916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminating (SIGTERM) 06:33:29.479873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Terminating (SIGTERM) 06:33:29.521821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2654): Terminating (SIGTERM) 06:33:29.563989 --- ParallelTerminationStrategy: PID 2642 died... 06:33:29.584144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2642): Terminated: ok {rc=0} 06:33:29.630531 --- ParallelTerminationStrategy: PID 2643 died... 06:33:29.650131 run iperf3-srv_10.42.42.10(pid=2643): Terminated {rc=256} 06:33:29.696074 --- ParallelTerminationStrategy: PID 2644 died... 06:33:29.715679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2644): Terminated: ok {rc=0} 06:33:29.761682 --- ParallelTerminationStrategy: PID 2645 died... 06:33:29.781184 run iperf3-srv_10.42.42.10(pid=2645): Terminated {rc=256} 06:33:29.827218 --- ParallelTerminationStrategy: PID 2648 died... 06:33:29.846795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2648): Terminated: ok {rc=0} 06:33:29.892840 --- ParallelTerminationStrategy: PID 2651 died... 06:33:29.912799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2651): Terminated: ok {rc=0} 06:33:29.959330 --- ParallelTerminationStrategy: PID 2654 died... 06:33:29.978814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2654): Terminated: ok {rc=0} 06:33:30.066641 bus /gobi_0: Setting Powered False 06:33:31.163093 bus /gobi_0: Setting Powered False 06:33:32.278621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:33:33.425518 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:33.437561 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:33.502079 tst iperf3.py: using LAC 19596 06:33:33.626655 tst iperf3.py: using RAC 216 06:33:33.752194 tst iperf3.py: using CellId 19596 06:33:33.878822 tst iperf3.py: using BVCI 19597 06:33:33.997104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.008490 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.019676 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.031361 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.042959 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.054608 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.066314 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.078019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:34.089821 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:34.207930 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:33:34.423513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:34.742173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2656): Launched 06:33:35.019211 run iperf3-srv_10.42.42.10(pid=2657): Launched 06:33:35.138765 tst iperf3.py:8: start network... 06:33:35.353931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:35.819274 run create_hlr_db(pid=2658): Launched 06:33:35.933241 bus /gobi_6: Setting Powered False 06:33:36.993185 run create_hlr_db(pid=2658): Terminated: ok {rc=0} 06:33:37.406747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2660): Launched 06:33:37.701908 run osmo-hlr_10.42.42.2(pid=2661): Launched 06:33:37.815211 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:38.325520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2663): Launched 06:33:38.645538 run osmo-stp_10.42.42.5(pid=2664): Launched 06:33:38.766736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:39.315805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2666): Launched 06:33:39.437571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:39.706127 run patchelf(pid=2667): Launched 06:33:39.883276 run osmo-stp_10.42.42.5(pid=2664): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2664)] 06:33:40.019292 run osmo-stp_10.42.42.5(pid=2664): stdout: | (launched: 2022-12-09_06:33:38.587655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:40.156030 run osmo-stp_10.42.42.5(pid=2664): stderr: | 20221209063338778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063338778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063338778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063338779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063338781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063338781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063338781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:40.292665 run osmo-stp_10.42.42.5(pid=2664): stdout: | (launched: 2022-12-09_06:33:38.587655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:40.425243 run osmo-stp_10.42.42.5(pid=2664): stderr: | 20221209063338778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063338778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063338778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063338779 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063338781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063338781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063338781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:40.582141 run patchelf(pid=2667): Terminating (SIGINT) 06:33:40.761503 run patchelf(pid=2667): Terminated: ok {rc=0} 06:33:40.891001 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2664): Process ended prematurely: osmo-stp_10.42.42.5(pid=2664) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2664)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:33:40.901073 tst iperf3.py:8: Test FAILED (7.5 sec) 06:33:40.929873 run osmo-hlr_10.42.42.2(pid=2661): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2661)] 06:33:40.980754 run osmo-hlr_10.42.42.2(pid=2661): stdout: | (launched: 2022-12-09_06:33:37.647580) 06:33:41.033175 run osmo-hlr_10.42.42.2(pid=2661): stderr: | 20221209063337820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063337820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063337820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063337821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063337821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063337821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063337832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063337841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063337841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063337841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:41.085692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2656): Terminating (SIGTERM) 06:33:41.128149 run iperf3-srv_10.42.42.10(pid=2657): Terminating (SIGTERM) 06:33:41.170321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2660): Terminating (SIGTERM) 06:33:41.212221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2663): Terminating (SIGTERM) 06:33:41.254030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2666): Terminating (SIGTERM) 06:33:41.296345 --- ParallelTerminationStrategy: PID 2656 died... 06:33:41.316446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2656): Terminated: ok {rc=0} 06:33:41.363473 --- ParallelTerminationStrategy: PID 2657 died... 06:33:41.383250 run iperf3-srv_10.42.42.10(pid=2657): Terminated {rc=256} 06:33:41.429266 --- ParallelTerminationStrategy: PID 2660 died... 06:33:41.448640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2660): Terminated: ok {rc=0} 06:33:41.494780 --- ParallelTerminationStrategy: PID 2663 died... 06:33:41.514526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2663): Terminated: ok {rc=0} 06:33:41.560619 --- ParallelTerminationStrategy: PID 2666 died... 06:33:41.580331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2666): Terminated: ok {rc=0} 06:33:41.667633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:33:42.816697 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:42.828769 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:33:42.891069 tst iperf3m4.py: using LAC 19597 06:33:43.019836 tst iperf3m4.py: using RAC 217 06:33:43.149170 tst iperf3m4.py: using CellId 19597 06:33:43.273957 tst iperf3m4.py: using BVCI 19598 06:33:43.389584 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.400808 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.411925 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.423054 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.434225 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.445397 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.456594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.467697 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:33:43.478965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:43.591745 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:43.712641 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:43.829296 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:33:43.943697 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:33:44.143408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:44.441153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2668): Launched 06:33:44.700621 run iperf3-srv_10.42.42.10(pid=2669): Launched 06:33:44.812147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:33:45.010523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:45.307249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2670): Launched 06:33:45.565493 run iperf3-srv_10.42.42.10(pid=2671): Launched 06:33:45.677582 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:33:45.893452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:46.205933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2672): Launched 06:33:46.495908 run iperf3-srv_10.42.42.10(pid=2673): Launched 06:33:46.615495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:33:46.818371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:33:47.136124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2675): Launched 06:33:47.399203 run iperf3-srv_10.42.42.10(pid=2676): Launched 06:33:47.510621 tst iperf3m4.py:8: start network... 06:33:47.708543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:33:48.169727 run create_hlr_db(pid=2677): Launched 06:33:48.301002 bus /gobi_6: Setting Powered False 06:33:49.364508 run create_hlr_db(pid=2677): Terminated: ok {rc=0} 06:33:49.808327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2679): Launched 06:33:50.126693 run osmo-hlr_10.42.42.2(pid=2680): Launched 06:33:50.246393 run osmo-stp_10.42.42.5: Starting osmo-stp 06:33:50.793132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2682): Launched 06:33:51.109507 run osmo-stp_10.42.42.5(pid=2683): Launched 06:33:51.229618 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:33:51.775168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2685): Launched 06:33:51.896737 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:33:52.165855 run patchelf(pid=2686): Launched 06:33:52.342226 run osmo-stp_10.42.42.5(pid=2683): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2683)] 06:33:52.476839 run osmo-stp_10.42.42.5(pid=2683): stdout: | (launched: 2022-12-09_06:33:51.051829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:52.612744 run osmo-stp_10.42.42.5(pid=2683): stderr: | 20221209063351239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063351240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063351240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063351240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063351241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063351241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063351241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:52.749052 run osmo-stp_10.42.42.5(pid=2683): stdout: | (launched: 2022-12-09_06:33:51.051829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:33:52.879986 run osmo-stp_10.42.42.5(pid=2683): stderr: | 20221209063351239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063351240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063351240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063351240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063351241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063351241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063351241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:33:53.035506 run patchelf(pid=2686): Terminating (SIGINT) 06:33:53.214439 run patchelf(pid=2686): Terminated: ok {rc=0} 06:33:53.343353 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2683): Process ended prematurely: osmo-stp_10.42.42.5(pid=2683) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2683)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:33:53.353356 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:33:53.381877 run osmo-hlr_10.42.42.2(pid=2680): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2680)] 06:33:53.431558 run osmo-hlr_10.42.42.2(pid=2680): stdout: | (launched: 2022-12-09_06:33:50.069004) 06:33:53.482745 run osmo-hlr_10.42.42.2(pid=2680): stderr: | 20221209063350266 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063350266 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063350266 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063350266 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063350266 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063350267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063350283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063350292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063350293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063350294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:33:53.534257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2668): Terminating (SIGTERM) 06:33:53.575754 run iperf3-srv_10.42.42.10(pid=2669): Terminating (SIGTERM) 06:33:53.617395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2670): Terminating (SIGTERM) 06:33:53.659017 run iperf3-srv_10.42.42.10(pid=2671): Terminating (SIGTERM) 06:33:53.700466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2672): Terminating (SIGTERM) 06:33:53.742219 run iperf3-srv_10.42.42.10(pid=2673): Terminating (SIGTERM) 06:33:53.783610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2675): Terminating (SIGTERM) 06:33:53.825095 run iperf3-srv_10.42.42.10(pid=2676): Terminating (SIGTERM) 06:33:53.866541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2679): Terminating (SIGTERM) 06:33:53.908094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2682): Terminating (SIGTERM) 06:33:53.949634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2685): Terminating (SIGTERM) 06:33:53.992152 --- ParallelTerminationStrategy: PID 2668 died... 06:33:54.012134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2668): Terminated: ok {rc=0} 06:33:54.058802 --- ParallelTerminationStrategy: PID 2669 died... 06:33:54.078370 run iperf3-srv_10.42.42.10(pid=2669): Terminated {rc=256} 06:33:54.124070 --- ParallelTerminationStrategy: PID 2670 died... 06:33:54.143388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2670): Terminated: ok {rc=0} 06:33:54.189061 --- ParallelTerminationStrategy: PID 2671 died... 06:33:54.208286 run iperf3-srv_10.42.42.10(pid=2671): Terminated {rc=256} 06:33:54.254137 --- ParallelTerminationStrategy: PID 2672 died... 06:33:54.273515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2672): Terminated: ok {rc=0} 06:33:54.319234 --- ParallelTerminationStrategy: PID 2673 died... 06:33:54.338590 run iperf3-srv_10.42.42.10(pid=2673): Terminated {rc=256} 06:33:54.384035 --- ParallelTerminationStrategy: PID 2675 died... 06:33:54.403428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2675): Terminated: ok {rc=0} 06:33:54.448774 --- ParallelTerminationStrategy: PID 2676 died... 06:33:54.468069 run iperf3-srv_10.42.42.10(pid=2676): Terminated {rc=256} 06:33:54.513346 --- ParallelTerminationStrategy: PID 2679 died... 06:33:54.532464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2679): Terminated: ok {rc=0} 06:33:54.578070 --- ParallelTerminationStrategy: PID 2682 died... 06:33:54.597480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2682): Terminated: ok {rc=0} 06:33:54.643358 --- ParallelTerminationStrategy: PID 2685 died... 06:33:54.663188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2685): Terminated: ok {rc=0} 06:33:54.751155 bus /gobi_4: Setting Powered False 06:33:55.852210 bus /gobi_4: Setting Powered False 06:33:56.969157 bus /gobi_1: Setting Powered False 06:33:58.069571 bus /gobi_1: Setting Powered False 06:33:59.186072 bus /gobi_0: Setting Powered False 06:34:00.284497 bus /gobi_0: Setting Powered False 06:34:01.407815 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:34:02.520890 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:02.532941 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:34:02.594637 tst ping.py: using LAC 19598 06:34:02.719428 tst ping.py: using RAC 218 06:34:02.844147 tst ping.py: using CellId 19598 06:34:02.966528 tst ping.py: using BVCI 19599 06:34:03.081475 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.092920 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.104229 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.115549 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.126755 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.138083 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.149478 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:03.160639 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:34:03.277076 tst ping.py:19: start network... 06:34:03.490079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:03.976835 run create_hlr_db(pid=2687): Launched 06:34:04.103994 bus /gobi_6: Setting Powered False 06:34:05.167070 run create_hlr_db(pid=2687): Terminated: ok {rc=0} 06:34:05.607095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Launched 06:34:05.920764 run osmo-hlr_10.42.42.2(pid=2690): Launched 06:34:06.043226 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:06.594079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Launched 06:34:06.906411 run osmo-stp_10.42.42.5(pid=2693): Launched 06:34:07.025453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:07.563611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Launched 06:34:07.683230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:07.945507 run patchelf(pid=2696): Launched 06:34:08.119763 run osmo-stp_10.42.42.5(pid=2693): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2693)] 06:34:08.252871 run osmo-stp_10.42.42.5(pid=2693): stdout: | (launched: 2022-12-09_06:34:06.849921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:08.387797 run osmo-stp_10.42.42.5(pid=2693): stderr: | 20221209063407041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063407041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063407041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063407042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063407042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063407042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063407042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:08.522549 run osmo-stp_10.42.42.5(pid=2693): stdout: | (launched: 2022-12-09_06:34:06.849921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:08.651077 run osmo-stp_10.42.42.5(pid=2693): stderr: | 20221209063407041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063407041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063407041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063407042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063407042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063407042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063407042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:08.803659 run patchelf(pid=2696): Terminating (SIGINT) 06:34:08.980512 run patchelf(pid=2696): Terminated: ok {rc=0} 06:34:09.107862 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2693): Process ended prematurely: osmo-stp_10.42.42.5(pid=2693) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2693)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 06:34:09.117422 tst ping.py:22: Test FAILED (6.6 sec) 06:34:09.145199 run osmo-hlr_10.42.42.2(pid=2690): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2690)] 06:34:09.194809 run osmo-hlr_10.42.42.2(pid=2690): stdout: | (launched: 2022-12-09_06:34:05.863256) 06:34:09.246260 run osmo-hlr_10.42.42.2(pid=2690): stderr: | 20221209063406062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063406062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063406062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063406062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063406062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063406062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063406075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063406083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063406083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063406083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:09.297866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Terminating (SIGTERM) 06:34:09.339314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Terminating (SIGTERM) 06:34:09.380743 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Terminating (SIGTERM) 06:34:09.422517 --- ParallelTerminationStrategy: PID 2689 died... 06:34:09.442167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Terminated: ok {rc=0} 06:34:09.487905 --- ParallelTerminationStrategy: PID 2692 died... 06:34:09.507175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Terminated: ok {rc=0} 06:34:09.552666 --- ParallelTerminationStrategy: PID 2695 died... 06:34:09.572127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Terminated: ok {rc=0} 06:34:09.658565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:34:10.746864 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:10.758894 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:34:10.821512 tst ping_idle_ping.py: using LAC 19599 06:34:10.945203 tst ping_idle_ping.py: using RAC 219 06:34:11.073528 tst ping_idle_ping.py: using CellId 19599 06:34:11.196128 tst ping_idle_ping.py: using BVCI 19600 06:34:11.302868 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.314062 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.324891 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.336560 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.348134 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.359637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.371356 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:34:11.382702 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:34:11.497883 tst ping_idle_ping.py:24: start network... 06:34:11.692171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:12.189631 run create_hlr_db(pid=2697): Launched 06:34:12.317641 bus /gobi_6: Setting Powered False 06:34:13.380117 run create_hlr_db(pid=2697): Terminated: ok {rc=0} 06:34:13.798968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Launched 06:34:14.090508 run osmo-hlr_10.42.42.2(pid=2700): Launched 06:34:14.201664 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:14.702484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Launched 06:34:14.993686 run osmo-stp_10.42.42.5(pid=2703): Launched 06:34:15.104180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:15.607696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Launched 06:34:15.719621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:15.994249 run patchelf(pid=2706): Launched 06:34:16.225612 run osmo-stp_10.42.42.5(pid=2703): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2703)] 06:34:16.384021 run osmo-stp_10.42.42.5(pid=2703): stdout: | (launched: 2022-12-09_06:34:14.940454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:16.523474 run osmo-stp_10.42.42.5(pid=2703): stderr: | 20221209063415108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063415108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063415109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063415109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063415110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063415110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063415110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:16.663290 run osmo-stp_10.42.42.5(pid=2703): stdout: | (launched: 2022-12-09_06:34:14.940454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:16.794509 run osmo-stp_10.42.42.5(pid=2703): stderr: | 20221209063415108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063415108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063415109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063415109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063415110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063415110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063415110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:16.951979 run patchelf(pid=2706): Terminating (SIGINT) 06:34:17.133807 run patchelf(pid=2706): Terminated: ok {rc=0} 06:34:17.263423 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2703): Process ended prematurely: osmo-stp_10.42.42.5(pid=2703) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2703)] [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:34:17.272840 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:34:17.300885 run osmo-hlr_10.42.42.2(pid=2700): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2700)] 06:34:17.350806 run osmo-hlr_10.42.42.2(pid=2700): stdout: | (launched: 2022-12-09_06:34:14.037406) 06:34:17.402333 run osmo-hlr_10.42.42.2(pid=2700): stderr: | 20221209063414209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063414209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063414209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063414209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063414209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063414209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063414222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063414233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063414233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063414233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:17.454154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Terminating (SIGTERM) 06:34:17.496058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Terminating (SIGTERM) 06:34:17.538474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Terminating (SIGTERM) 06:34:17.580394 --- ParallelTerminationStrategy: PID 2699 died... 06:34:17.600590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Terminated: ok {rc=0} 06:34:17.646662 --- ParallelTerminationStrategy: PID 2702 died... 06:34:17.666305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Terminated: ok {rc=0} 06:34:17.712191 --- ParallelTerminationStrategy: PID 2705 died... 06:34:17.731882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Terminated: ok {rc=0} 06:34:17.818889 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:34:19.116287 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:19.124786 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:34:19.149621 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:34:19.184312 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:34:19.237819 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:34:19.261888 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:34:19.296539 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:34:19.860015 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:34:19.865271 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:19.877207 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:34:19.937879 tst switch_tch_pdch.py: using LAC 19600 06:34:20.060911 tst switch_tch_pdch.py: using RAC 220 06:34:20.182332 tst switch_tch_pdch.py: using CellId 19600 06:34:20.305753 tst switch_tch_pdch.py: using BVCI 19601 06:34:20.419986 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.431950 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.443675 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.455464 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.467174 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.479012 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.490872 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:34:20.502702 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:34:20.622138 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:34:20.737110 tst switch_tch_pdch.py:51: start network... 06:34:20.945658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:21.432009 run create_hlr_db(pid=2710): Launched 06:34:21.559234 bus /gobi_6: Setting Powered False 06:34:22.622840 run create_hlr_db(pid=2710): Terminated: ok {rc=0} 06:34:23.041885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2712): Launched 06:34:23.332239 run osmo-hlr_10.42.42.2(pid=2713): Launched 06:34:23.442934 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:23.943310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2715): Launched 06:34:24.233137 run osmo-stp_10.42.42.5(pid=2716): Launched 06:34:24.342678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:34:24.843079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2718): Launched 06:34:24.955494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:34:25.200322 run patchelf(pid=2719): Launched 06:34:25.363085 run osmo-stp_10.42.42.5(pid=2716): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2716)] 06:34:25.486860 run osmo-stp_10.42.42.5(pid=2716): stdout: | (launched: 2022-12-09_06:34:24.180060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:25.612135 run osmo-stp_10.42.42.5(pid=2716): stderr: | 20221209063424349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063424349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063424349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063424350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063424350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063424351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063424351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:25.737300 run osmo-stp_10.42.42.5(pid=2716): stdout: | (launched: 2022-12-09_06:34:24.180060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:25.856628 run osmo-stp_10.42.42.5(pid=2716): stderr: | 20221209063424349 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063424349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063424349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063424350 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063424350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063424351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063424351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:25.998070 run patchelf(pid=2719): Terminating (SIGINT) 06:34:26.162182 run patchelf(pid=2719): Terminated: ok {rc=0} 06:34:26.280399 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2716): Process ended prematurely: osmo-stp_10.42.42.5(pid=2716) [trial-2355↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2716)] [trial-2355↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:34:26.289160 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 06:34:26.315939 run osmo-hlr_10.42.42.2(pid=2713): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2713)] 06:34:26.363788 run osmo-hlr_10.42.42.2(pid=2713): stdout: | (launched: 2022-12-09_06:34:23.279043) 06:34:26.413288 run osmo-hlr_10.42.42.2(pid=2713): stderr: | 20221209063423454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063423454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063423454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063423454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063423454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063423454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063423467 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063423475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063423475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063423475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:26.462634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2712): Terminating (SIGTERM) 06:34:26.502744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2715): Terminating (SIGTERM) 06:34:26.542497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2718): Terminating (SIGTERM) 06:34:26.582537 --- ParallelTerminationStrategy: PID 2712 died... 06:34:26.601620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2712): Terminated: ok {rc=0} 06:34:26.645865 --- ParallelTerminationStrategy: PID 2715 died... 06:34:26.664126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2715): Terminated: ok {rc=0} 06:34:26.708262 --- ParallelTerminationStrategy: PID 2718 died... 06:34:26.727144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2718): Terminated: ok {rc=0} 06:34:26.812277 bus /gobi_0: Setting Powered False 06:34:27.910591 bus /gobi_0: Setting Powered False 06:34:29.026594 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 sms:nanobts+band-900 --------------------------------------------------------------------- 06:34:30.271021 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:30.276316 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:34:30.309203 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:34:30.336531 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 06:34:30.388396 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:34:30.420939 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:34:30.447845 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 06:34:30.999522 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 06:34:31.009413 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.024097 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 06:34:31.076930 tst mo_mt_sms.py: using LAC 19601 06:34:31.196672 tst mo_mt_sms.py: using RAC 221 06:34:31.317340 tst mo_mt_sms.py: using CellId 19601 06:34:31.439703 tst mo_mt_sms.py: using BVCI 19602 06:34:31.549755 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.561527 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.573060 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.585102 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.597822 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:31.612322 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:34:31.731300 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 06:34:31.875490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:32.370401 run create_hlr_db(pid=2723): Launched 06:34:32.496792 bus /gobi_6: Setting Powered False 06:34:33.559270 run create_hlr_db(pid=2723): Terminated: ok {rc=0} 06:34:33.977650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Launched 06:34:34.268890 run osmo-hlr_10.42.42.2(pid=2726): Launched 06:34:34.381194 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:34.893398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Launched 06:34:35.184097 run osmo-stp_10.42.42.5(pid=2729): Launched 06:34:35.293856 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:35.819284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Launched 06:34:36.111126 run osmo-msc_10.42.42.6(pid=2732): Launched 06:34:36.273302 run osmo-stp_10.42.42.5(pid=2729): ERR: Terminated: ERROR {rc=1} [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] 06:34:36.397316 run osmo-stp_10.42.42.5(pid=2729): stdout: | (launched: 2022-12-09_06:34:35.131068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:36.522243 run osmo-stp_10.42.42.5(pid=2729): stderr: | 20221209063435301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063435301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063435301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063435302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063435302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063435302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063435302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:36.643961 run osmo-stp_10.42.42.5(pid=2729): stdout: | (launched: 2022-12-09_06:34:35.131068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:36.759729 run osmo-stp_10.42.42.5(pid=2729): stderr: | 20221209063435301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063435301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063435301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063435302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063435302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063435302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063435302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:36.898386 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2729): Process ended prematurely: osmo-stp_10.42.42.5(pid=2729) [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py:16] 06:34:36.906342 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 06:34:36.932558 run osmo-hlr_10.42.42.2(pid=2726): ERR: Terminated: ERROR {rc=237} [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2726)] 06:34:36.980547 run osmo-hlr_10.42.42.2(pid=2726): stdout: | (launched: 2022-12-09_06:34:34.215600) 06:34:37.030047 run osmo-hlr_10.42.42.2(pid=2726): stderr: | 20221209063434386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063434387 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063434387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063434387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063434387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063434387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063434402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063434412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063434412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063434412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:37.099007 run osmo-msc_10.42.42.6(pid=2732): ERR: Terminated: ERROR {rc=2} [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2732)] 06:34:37.146417 run osmo-msc_10.42.42.6(pid=2732): stdout: | (launched: 2022-12-09_06:34:36.057743) 06:34:37.195574 run osmo-msc_10.42.42.6(pid=2732): stderr: | 20221209063436328 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063436328 DLGLOBAL DEBUG validating counter group 0x7fc8e9337c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063436329 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063436329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063436329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063436329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063436331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063436331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063436331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063436331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:37.245323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Terminating (SIGTERM) 06:34:37.284802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Terminating (SIGTERM) 06:34:37.324414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Terminating (SIGTERM) 06:34:37.364211 --- ParallelTerminationStrategy: PID 2725 died... 06:34:37.383133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Terminated: ok {rc=0} 06:34:37.427306 --- ParallelTerminationStrategy: PID 2728 died... 06:34:37.445818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Terminated: ok {rc=0} 06:34:37.489806 --- ParallelTerminationStrategy: PID 2731 died... 06:34:37.508166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Terminated: ok {rc=0} 06:34:37.591977 bus /sierra_3: Setting Powered False 06:34:38.689714 bus /sierra_3: Setting Powered False 06:34:39.807939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 06:34:41.038832 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:41.043501 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:34:41.075848 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 06:34:41.082437 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:34:41.116702 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:34:41.149169 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 06:34:41.155897 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:34:41.674400 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:34:41.679523 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 06:34:41.690438 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:34:41.737882 tst assert_extension.py: using LAC 19602 06:34:41.854014 tst assert_extension.py: using RAC 222 06:34:41.970341 tst assert_extension.py: using CellId 19602 06:34:42.085122 tst assert_extension.py: using BVCI 19603 06:34:42.199128 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:34:42.314709 tst assert_extension.py:10: start nitb and bts... 06:34:42.526602 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:34:43.165650 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2738): Launched 06:34:43.477266 run osmo-nitb_10.42.42.2(pid=2739): Launched 06:34:43.649919 run osmo-nitb_10.42.42.2(pid=2739): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2739)] 06:34:43.790388 run osmo-nitb_10.42.42.2(pid=2739): stdout: | (launched: 2022-12-09_06:34:43.420809) 06:34:43.933057 run osmo-nitb_10.42.42.2(pid=2739): stderr: | (launched: 2022-12-09_06:34:43.467338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:34:44.075789 run osmo-nitb_10.42.42.2(pid=2739): stdout: | (launched: 2022-12-09_06:34:43.420809) 06:34:44.211923 run osmo-nitb_10.42.42.2(pid=2739): stderr: | (launched: 2022-12-09_06:34:43.467338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2739): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2739) [trial-2355↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2739)] 06:34:44.594699 tst osmo-nitb_10.42.42.2(pid=2739): stdout: | (launched: 2022-12-09_06:34:43.420809) 06:34:44.721142 tst osmo-nitb_10.42.42.2(pid=2739): stderr: | (launched: 2022-12-09_06:34:43.467338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:34:44.869253 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2739): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2739) [trial-2355↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2739)] [trial-2355↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 06:34:44.878090 tst assert_extension.py:12: Test FAILED (3.2 sec) 06:34:44.884797 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2738): Terminating (SIGTERM) 06:34:45.095172 --- ParallelTerminationStrategy: PID 2738 died... 06:34:45.116664 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2738): Terminated: ok {rc=0} 06:34:45.203358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 ussd:nanobts+band-900 --------------------------------------------------------------------- 06:34:46.387193 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:46.394052 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:34:46.429079 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:34:46.456773 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 06:34:46.494181 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:34:46.532738 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:34:46.567010 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 06:34:47.125596 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 06:34:47.130462 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.144673 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 06:34:47.200183 tst assert_extension.py: using LAC 19603 06:34:47.316900 tst assert_extension.py: using RAC 223 06:34:47.441720 tst assert_extension.py: using CellId 19603 06:34:47.563695 tst assert_extension.py: using BVCI 19604 06:34:47.676827 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.688044 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.699260 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.710503 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.721743 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:34:47.732810 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 06:34:47.846238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:48.330126 run create_hlr_db(pid=2743): Launched 06:34:48.456668 bus /sierra_2: Setting Powered False 06:34:49.519063 run create_hlr_db(pid=2743): Terminated: ok {rc=0} 06:34:49.954222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2745): Launched 06:34:50.267140 run osmo-hlr_10.42.42.2(pid=2746): Launched 06:34:50.385737 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:50.923812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2748): Launched 06:34:51.236462 run osmo-stp_10.42.42.5(pid=2749): Launched 06:34:51.354533 run osmo-msc_10.42.42.6: Starting osmo-msc 06:34:51.915541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2751): Launched 06:34:52.227741 run osmo-msc_10.42.42.6(pid=2752): Launched 06:34:52.401981 run osmo-stp_10.42.42.5(pid=2749): ERR: Terminated: ERROR {rc=1} [trial-2355↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2749)] 06:34:52.534201 run osmo-stp_10.42.42.5(pid=2749): stdout: | (launched: 2022-12-09_06:34:51.179677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:52.667184 run osmo-stp_10.42.42.5(pid=2749): stderr: | 20221209063451370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063451370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063451370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063451370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063451371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063451371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063451371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:52.799232 run osmo-stp_10.42.42.5(pid=2749): stdout: | (launched: 2022-12-09_06:34:51.179677) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:34:52.923305 run osmo-stp_10.42.42.5(pid=2749): stderr: | 20221209063451370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063451370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063451370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063451370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063451371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063451371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063451371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:34:53.072511 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2749): Process ended prematurely: osmo-stp_10.42.42.5(pid=2749) [trial-2355↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2749)] [trial-2355↪ussd:nanobts+band-900↪assert_extension.py:17] 06:34:53.081473 tst assert_extension.py:17: Test FAILED (5.9 sec) 06:34:53.108871 run osmo-hlr_10.42.42.2(pid=2746): ERR: Terminated: ERROR {rc=237} [trial-2355↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2746)] 06:34:53.158751 run osmo-hlr_10.42.42.2(pid=2746): stdout: | (launched: 2022-12-09_06:34:50.210552) 06:34:53.210424 run osmo-hlr_10.42.42.2(pid=2746): stderr: | 20221209063450409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063450409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063450409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063450409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063450409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063450409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063450422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063450430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063450430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063450430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:34:53.281856 run osmo-msc_10.42.42.6(pid=2752): ERR: Terminated: ERROR {rc=2} [trial-2355↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2752)] 06:34:53.331472 run osmo-msc_10.42.42.6(pid=2752): stdout: | (launched: 2022-12-09_06:34:52.170493) 06:34:53.382522 run osmo-msc_10.42.42.6(pid=2752): stderr: | 20221209063452489 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063452490 DLGLOBAL DEBUG validating counter group 0x7f53cc3b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063452490 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063452490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063452490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063452490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063452492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063452492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063452492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063452492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:34:53.434065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2745): Terminating (SIGTERM) 06:34:53.475351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2748): Terminating (SIGTERM) 06:34:53.516642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2751): Terminating (SIGTERM) 06:34:53.558324 --- ParallelTerminationStrategy: PID 2745 died... 06:34:53.578201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2745): Terminated: ok {rc=0} 06:34:53.624342 --- ParallelTerminationStrategy: PID 2748 died... 06:34:53.643864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2748): Terminated: ok {rc=0} 06:34:53.689665 --- ParallelTerminationStrategy: PID 2751 died... 06:34:53.709245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2751): Terminated: ok {rc=0} 06:34:53.796531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:34:55.005952 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:34:55.013576 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:34:55.047638 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:34:55.073579 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:34:55.125663 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:34:55.159120 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:34:55.186066 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:34:55.738598 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:34:55.790023 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:55.801131 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:34:55.866928 tst mo_mt_call.py: using LAC 19604 06:34:55.983159 tst mo_mt_call.py: using RAC 224 06:34:56.100214 tst mo_mt_call.py: using CellId 19604 06:34:56.217338 tst mo_mt_call.py: using BVCI 19605 06:34:56.325398 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:56.336753 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:56.347820 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:56.359613 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:56.371342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:34:56.382908 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:56.500369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:34:56.615105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:34:57.073840 run create_hlr_db(pid=2757): Launched 06:34:57.186468 bus /sierra_2: Setting Powered False 06:34:58.245696 run create_hlr_db(pid=2757): Terminated: ok {rc=0} 06:34:58.678451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2759): Launched 06:34:58.994530 run osmo-hlr_10.42.42.2(pid=2760): Launched 06:34:59.115330 run osmo-stp_10.42.42.5: Starting osmo-stp 06:34:59.666312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2762): Launched 06:34:59.981438 run osmo-stp_10.42.42.5(pid=2763): Launched 06:35:00.102472 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:00.676846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2765): Launched 06:35:01.038978 run osmo-msc_10.42.42.6(pid=2766): Launched 06:35:01.390648 run osmo-stp_10.42.42.5(pid=2763): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2763)] 06:35:01.627775 run osmo-stp_10.42.42.5(pid=2763): stdout: | (launched: 2022-12-09_06:34:59.924133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:01.822765 run osmo-stp_10.42.42.5(pid=2763): stderr: | 20221209063500114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063500114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063500114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063500115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063500115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063500115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063500115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:01.957146 run osmo-stp_10.42.42.5(pid=2763): stdout: | (launched: 2022-12-09_06:34:59.924133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:02.086015 run osmo-stp_10.42.42.5(pid=2763): stderr: | 20221209063500114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063500114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063500114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063500115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063500115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063500115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063500115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:02.238923 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2763): Process ended prematurely: osmo-stp_10.42.42.5(pid=2763) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2763)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:35:02.248322 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:35:02.276178 run osmo-hlr_10.42.42.2(pid=2760): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2760)] 06:35:02.326743 run osmo-hlr_10.42.42.2(pid=2760): stdout: | (launched: 2022-12-09_06:34:58.937291) 06:35:02.378894 run osmo-hlr_10.42.42.2(pid=2760): stderr: | 20221209063459135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063459135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063459135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063459135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063459135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063459135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063459147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063459157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063459157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063459158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:02.451553 run osmo-msc_10.42.42.6(pid=2766): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2766)] 06:35:02.501590 run osmo-msc_10.42.42.6(pid=2766): stdout: | (launched: 2022-12-09_06:35:00.964900) 06:35:02.553433 run osmo-msc_10.42.42.6(pid=2766): stderr: | 20221209063501463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063501463 DLGLOBAL DEBUG validating counter group 0x7f3cde69ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063501463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063501463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063501463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063501463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063501467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063501467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063501467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063501467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:02.606203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2759): Terminating (SIGTERM) 06:35:02.647958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2762): Terminating (SIGTERM) 06:35:02.689835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2765): Terminating (SIGTERM) 06:35:02.732086 --- ParallelTerminationStrategy: PID 2759 died... 06:35:02.752185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2759): Terminated: ok {rc=0} 06:35:02.798421 --- ParallelTerminationStrategy: PID 2762 died... 06:35:02.817973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2762): Terminated: ok {rc=0} 06:35:02.863946 --- ParallelTerminationStrategy: PID 2765 died... 06:35:02.883506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2765): Terminated: ok {rc=0} 06:35:02.970303 bus /sierra_3: Setting Powered False 06:35:04.068512 bus /sierra_3: Setting Powered False 06:35:05.184840 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:35:06.329415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.341142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:35:06.407129 tst mo_mt_call_osmux.py: using LAC 19605 06:35:06.533566 tst mo_mt_call_osmux.py: using RAC 225 06:35:06.660507 tst mo_mt_call_osmux.py: using CellId 19605 06:35:06.786447 tst mo_mt_call_osmux.py: using BVCI 19606 06:35:06.902004 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.913529 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.924739 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.936087 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.947473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:35:06.958856 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:35:07.078531 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:35:07.193518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:07.656615 run create_hlr_db(pid=2771): Launched 06:35:07.787651 bus /sierra_2: Setting Powered False 06:35:08.850697 run create_hlr_db(pid=2771): Terminated: ok {rc=0} 06:35:09.276919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2773): Launched 06:35:09.573528 run osmo-hlr_10.42.42.2(pid=2774): Launched 06:35:09.685923 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:10.195539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2776): Launched 06:35:10.492321 run osmo-stp_10.42.42.5(pid=2777): Launched 06:35:10.605737 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:11.142212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2779): Launched 06:35:11.438539 run osmo-msc_10.42.42.6(pid=2780): Launched 06:35:11.604387 run osmo-stp_10.42.42.5(pid=2777): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2777)] 06:35:11.730934 run osmo-stp_10.42.42.5(pid=2777): stdout: | (launched: 2022-12-09_06:35:10.437695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:11.857329 run osmo-stp_10.42.42.5(pid=2777): stderr: | 20221209063510610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063510610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063510610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063510611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063510613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063510613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063510613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:11.981865 run osmo-stp_10.42.42.5(pid=2777): stdout: | (launched: 2022-12-09_06:35:10.437695) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:12.100112 run osmo-stp_10.42.42.5(pid=2777): stderr: | 20221209063510610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063510610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063510610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063510611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063510613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063510613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063510613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:12.241593 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2777): Process ended prematurely: osmo-stp_10.42.42.5(pid=2777) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2777)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:35:12.250527 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:35:12.277356 run osmo-hlr_10.42.42.2(pid=2774): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2774)] 06:35:12.325471 run osmo-hlr_10.42.42.2(pid=2774): stdout: | (launched: 2022-12-09_06:35:09.519212) 06:35:12.375441 run osmo-hlr_10.42.42.2(pid=2774): stderr: | 20221209063509697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063509697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063509697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063509697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063509697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063509697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063509709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063509717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063509718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063509718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:12.444714 run osmo-msc_10.42.42.6(pid=2780): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2780)] 06:35:12.492460 run osmo-msc_10.42.42.6(pid=2780): stdout: | (launched: 2022-12-09_06:35:11.384248) 06:35:12.541955 run osmo-msc_10.42.42.6(pid=2780): stderr: | 20221209063511655 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063511656 DLGLOBAL DEBUG validating counter group 0x7f8560b94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063511656 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063511656 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063511656 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063511657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063511658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063511659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063511659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063511659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:12.592042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2773): Terminating (SIGTERM) 06:35:12.632163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2776): Terminating (SIGTERM) 06:35:12.672375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2779): Terminating (SIGTERM) 06:35:12.712772 --- ParallelTerminationStrategy: PID 2773 died... 06:35:12.731930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2773): Terminated: ok {rc=0} 06:35:12.776543 --- ParallelTerminationStrategy: PID 2776 died... 06:35:12.795363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2776): Terminated: ok {rc=0} 06:35:12.839695 --- ParallelTerminationStrategy: PID 2779 died... 06:35:12.858373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2779): Terminated: ok {rc=0} 06:35:12.943899 bus /sierra_3: Setting Powered False 06:35:14.045155 bus /sierra_3: Setting Powered False 06:35:15.160600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:35:16.450795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:16.460794 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:35:16.495772 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:35:16.524013 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:35:16.577940 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:35:16.630298 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:35:16.659222 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:35:17.189463 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:35:17.243369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.255871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:35:17.324678 tst mo_mt_call.py: using LAC 19606 06:35:17.448319 tst mo_mt_call.py: using RAC 226 06:35:17.565645 tst mo_mt_call.py: using CellId 19606 06:35:17.691675 tst mo_mt_call.py: using BVCI 19607 06:35:17.808036 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.819723 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.831301 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.843922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.856071 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:17.867408 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:35:17.982289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:35:18.096287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:18.553226 run create_hlr_db(pid=2785): Launched 06:35:18.667495 bus /sierra_2: Setting Powered False 06:35:19.727037 run create_hlr_db(pid=2785): Terminated: ok {rc=0} 06:35:20.161236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2787): Launched 06:35:20.478587 run osmo-hlr_10.42.42.2(pid=2788): Launched 06:35:20.600265 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:21.149332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2790): Launched 06:35:21.468485 run osmo-stp_10.42.42.5(pid=2791): Launched 06:35:21.591186 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:22.166530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2793): Launched 06:35:22.484096 run osmo-msc_10.42.42.6(pid=2794): Launched 06:35:22.662902 run osmo-stp_10.42.42.5(pid=2791): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2791)] 06:35:22.798541 run osmo-stp_10.42.42.5(pid=2791): stdout: | (launched: 2022-12-09_06:35:21.410513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:22.934406 run osmo-stp_10.42.42.5(pid=2791): stderr: | 20221209063521602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063521602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063521602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063521603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063521603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063521603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063521603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:23.068935 run osmo-stp_10.42.42.5(pid=2791): stdout: | (launched: 2022-12-09_06:35:21.410513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:23.195408 run osmo-stp_10.42.42.5(pid=2791): stderr: | 20221209063521602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063521602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063521602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063521603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063521603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063521603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063521603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:23.347623 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2791): Process ended prematurely: osmo-stp_10.42.42.5(pid=2791) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2791)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:35:23.356922 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:35:23.385029 run osmo-hlr_10.42.42.2(pid=2788): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2788)] 06:35:23.434896 run osmo-hlr_10.42.42.2(pid=2788): stdout: | (launched: 2022-12-09_06:35:20.421379) 06:35:23.486861 run osmo-hlr_10.42.42.2(pid=2788): stderr: | 20221209063520619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063520619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063520620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063520620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063520620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063520620 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063520633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063520642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063520643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063520643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:23.559331 run osmo-msc_10.42.42.6(pid=2794): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2794)] 06:35:23.609230 run osmo-msc_10.42.42.6(pid=2794): stdout: | (launched: 2022-12-09_06:35:22.426306) 06:35:23.660792 run osmo-msc_10.42.42.6(pid=2794): stderr: | 20221209063522746 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063522746 DLGLOBAL DEBUG validating counter group 0x7f537c4cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063522746 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063522746 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063522747 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063522747 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063522748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063522749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063522749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063522749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:23.712829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2787): Terminating (SIGTERM) 06:35:23.754415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2790): Terminating (SIGTERM) 06:35:23.796217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2793): Terminating (SIGTERM) 06:35:23.838532 --- ParallelTerminationStrategy: PID 2787 died... 06:35:23.858160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2787): Terminated: ok {rc=0} 06:35:23.904387 --- ParallelTerminationStrategy: PID 2790 died... 06:35:23.924026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2790): Terminated: ok {rc=0} 06:35:23.969975 --- ParallelTerminationStrategy: PID 2793 died... 06:35:23.989640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2793): Terminated: ok {rc=0} 06:35:24.077047 bus /sierra_3: Setting Powered False 06:35:25.175650 bus /sierra_3: Setting Powered False 06:35:26.289590 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:35:27.430721 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:27.442632 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:35:27.513787 tst mo_mt_call_osmux.py: using LAC 19607 06:35:27.641738 tst mo_mt_call_osmux.py: using RAC 227 06:35:27.766965 tst mo_mt_call_osmux.py: using CellId 19607 06:35:27.890306 tst mo_mt_call_osmux.py: using BVCI 19608 06:35:28.008866 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:28.020708 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:28.032136 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:28.043451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:28.055063 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:35:28.066509 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:35:28.184588 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:35:28.299655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:28.762155 run create_hlr_db(pid=2796): Launched 06:35:28.876243 bus /sierra_2: Setting Powered False 06:35:29.936472 run create_hlr_db(pid=2796): Terminated: ok {rc=0} 06:35:30.372701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Launched 06:35:30.691227 run osmo-hlr_10.42.42.2(pid=2799): Launched 06:35:30.811673 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:31.459757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Launched 06:35:31.859603 run osmo-stp_10.42.42.5(pid=2802): Launched 06:35:32.160651 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:32.728516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2804): Launched 06:35:33.024832 run osmo-msc_10.42.42.6(pid=2805): Launched 06:35:33.192500 run osmo-stp_10.42.42.5(pid=2802): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2802)] 06:35:33.320000 run osmo-stp_10.42.42.5(pid=2802): stdout: | (launched: 2022-12-09_06:35:31.779790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:33.447062 run osmo-stp_10.42.42.5(pid=2802): stderr: | 20221209063532003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063532004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063532004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063532004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063532005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063532005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063532005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:33.571760 run osmo-stp_10.42.42.5(pid=2802): stdout: | (launched: 2022-12-09_06:35:31.779790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:33.690160 run osmo-stp_10.42.42.5(pid=2802): stderr: | 20221209063532003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063532004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063532004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063532004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063532005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063532005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063532005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:33.831832 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2802): Process ended prematurely: osmo-stp_10.42.42.5(pid=2802) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2802)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:35:33.840619 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:35:33.867282 run osmo-hlr_10.42.42.2(pid=2799): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2799)] 06:35:33.915148 run osmo-hlr_10.42.42.2(pid=2799): stdout: | (launched: 2022-12-09_06:35:30.632783) 06:35:33.964517 run osmo-hlr_10.42.42.2(pid=2799): stderr: | 20221209063530829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063530829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063530829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063530829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063530837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063530837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063530860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063530878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063530878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063530878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:34.033703 run osmo-msc_10.42.42.6(pid=2805): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2805)] 06:35:34.081523 run osmo-msc_10.42.42.6(pid=2805): stdout: | (launched: 2022-12-09_06:35:32.970957) 06:35:34.130871 run osmo-msc_10.42.42.6(pid=2805): stderr: | 20221209063533238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063533238 DLGLOBAL DEBUG validating counter group 0x7f281abcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063533238 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063533239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063533239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063533239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063533241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063533241 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063533241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063533241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:34.180608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Terminating (SIGTERM) 06:35:34.220444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Terminating (SIGTERM) 06:35:34.260229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2804): Terminating (SIGTERM) 06:35:34.300218 --- ParallelTerminationStrategy: PID 2798 died... 06:35:34.319294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Terminated: ok {rc=0} 06:35:34.363555 --- ParallelTerminationStrategy: PID 2801 died... 06:35:34.381889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Terminated: ok {rc=0} 06:35:34.426631 --- ParallelTerminationStrategy: PID 2804 died... 06:35:34.445127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2804): Terminated: ok {rc=0} 06:35:34.531098 bus /sierra_3: Setting Powered False 06:35:35.629041 bus /sierra_3: Setting Powered False 06:35:36.742278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:35:37.984296 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:37.991409 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:35:38.023546 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:35:38.049954 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:35:38.102000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:35:38.134199 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:35:38.160220 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:35:38.709783 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:35:38.757462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:38.768520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:35:38.833761 tst mo_mt_call.py: using LAC 19608 06:35:38.960745 tst mo_mt_call.py: using RAC 228 06:35:39.087522 tst mo_mt_call.py: using CellId 19608 06:35:39.214416 tst mo_mt_call.py: using BVCI 19609 06:35:39.324193 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:39.335436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:39.346440 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:39.357769 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:39.369065 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:39.380237 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:39.495082 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:39.609197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:40.072407 run create_hlr_db(pid=2811): Launched 06:35:40.185613 bus /sierra_2: Setting Powered False 06:35:41.244909 run create_hlr_db(pid=2811): Terminated: ok {rc=0} 06:35:41.659500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Launched 06:35:41.955446 run osmo-hlr_10.42.42.2(pid=2814): Launched 06:35:42.067789 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:42.580426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Launched 06:35:42.877460 run osmo-stp_10.42.42.5(pid=2817): Launched 06:35:42.990289 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:43.527721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Launched 06:35:43.823466 run osmo-msc_10.42.42.6(pid=2820): Launched 06:35:43.988439 run osmo-stp_10.42.42.5(pid=2817): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] 06:35:44.115216 run osmo-stp_10.42.42.5(pid=2817): stdout: | (launched: 2022-12-09_06:35:42.822681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:44.240836 run osmo-stp_10.42.42.5(pid=2817): stderr: | 20221209063542991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063542991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063542992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063542992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063542994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063542994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063542994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:44.364622 run osmo-stp_10.42.42.5(pid=2817): stdout: | (launched: 2022-12-09_06:35:42.822681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:44.482415 run osmo-stp_10.42.42.5(pid=2817): stderr: | 20221209063542991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063542991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063542992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063542992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063542994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063542994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063542994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:44.623666 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2817): Process ended prematurely: osmo-stp_10.42.42.5(pid=2817) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:35:44.632528 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:35:44.659368 run osmo-hlr_10.42.42.2(pid=2814): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2814)] 06:35:44.707487 run osmo-hlr_10.42.42.2(pid=2814): stdout: | (launched: 2022-12-09_06:35:41.901489) 06:35:44.756870 run osmo-hlr_10.42.42.2(pid=2814): stderr: | 20221209063542077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063542077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063542077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063542077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063542077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063542077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063542089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063542097 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063542098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063542098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:44.825725 run osmo-msc_10.42.42.6(pid=2820): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2820)] 06:35:44.873250 run osmo-msc_10.42.42.6(pid=2820): stdout: | (launched: 2022-12-09_06:35:43.769484) 06:35:44.922452 run osmo-msc_10.42.42.6(pid=2820): stderr: | 20221209063544039 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063544039 DLGLOBAL DEBUG validating counter group 0x7f7925787c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063544039 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063544039 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063544039 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063544040 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063544042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063544042 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063544042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063544042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:44.972042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Terminating (SIGTERM) 06:35:45.011860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Terminating (SIGTERM) 06:35:45.051727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Terminating (SIGTERM) 06:35:45.092069 --- ParallelTerminationStrategy: PID 2813 died... 06:35:45.111207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2813): Terminated: ok {rc=0} 06:35:45.155828 --- ParallelTerminationStrategy: PID 2816 died... 06:35:45.174607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2816): Terminated: ok {rc=0} 06:35:45.219212 --- ParallelTerminationStrategy: PID 2819 died... 06:35:45.237936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2819): Terminated: ok {rc=0} 06:35:45.323478 bus /sierra_3: Setting Powered False 06:35:46.424393 bus /sierra_3: Setting Powered False 06:35:47.539324 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:35:48.686859 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:48.698992 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:35:48.774529 tst mo_mt_call_osmux.py: using LAC 19609 06:35:48.901383 tst mo_mt_call_osmux.py: using RAC 229 06:35:49.026863 tst mo_mt_call_osmux.py: using CellId 19609 06:35:49.152125 tst mo_mt_call_osmux.py: using BVCI 19610 06:35:49.262181 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:49.273520 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:49.284580 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:49.295974 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:49.307448 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:35:49.319000 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:49.434089 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:35:49.557569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:35:50.053500 run create_hlr_db(pid=2822): Launched 06:35:50.184306 bus /sierra_2: Setting Powered False 06:35:51.247967 run create_hlr_db(pid=2822): Terminated: ok {rc=0} 06:35:51.673357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2824): Launched 06:35:51.992571 run osmo-hlr_10.42.42.2(pid=2825): Launched 06:35:52.114151 run osmo-stp_10.42.42.5: Starting osmo-stp 06:35:52.661732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2827): Launched 06:35:52.979291 run osmo-stp_10.42.42.5(pid=2828): Launched 06:35:53.100166 run osmo-msc_10.42.42.6: Starting osmo-msc 06:35:53.674801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2830): Launched 06:35:53.991890 run osmo-msc_10.42.42.6(pid=2831): Launched 06:35:54.169275 run osmo-stp_10.42.42.5(pid=2828): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2828)] 06:35:54.304453 run osmo-stp_10.42.42.5(pid=2828): stdout: | (launched: 2022-12-09_06:35:52.921776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:54.439656 run osmo-stp_10.42.42.5(pid=2828): stderr: | 20221209063553112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063553112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063553112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063553113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063553113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063553113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063553113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:54.574187 run osmo-stp_10.42.42.5(pid=2828): stdout: | (launched: 2022-12-09_06:35:52.921776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:35:54.700227 run osmo-stp_10.42.42.5(pid=2828): stderr: | 20221209063553112 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063553112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063553112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063553113 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063553113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063553113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063553113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:35:54.851293 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2828): Process ended prematurely: osmo-stp_10.42.42.5(pid=2828) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2828)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:35:54.860543 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:35:54.888035 run osmo-hlr_10.42.42.2(pid=2825): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2825)] 06:35:54.937497 run osmo-hlr_10.42.42.2(pid=2825): stdout: | (launched: 2022-12-09_06:35:51.934618) 06:35:54.988677 run osmo-hlr_10.42.42.2(pid=2825): stderr: | 20221209063552134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063552134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063552134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063552134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063552134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063552134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063552147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063552156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063552156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063552156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:35:55.060714 run osmo-msc_10.42.42.6(pid=2831): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2831)] 06:35:55.110453 run osmo-msc_10.42.42.6(pid=2831): stdout: | (launched: 2022-12-09_06:35:53.934247) 06:35:55.161573 run osmo-msc_10.42.42.6(pid=2831): stderr: | 20221209063554255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063554256 DLGLOBAL DEBUG validating counter group 0x7f7d7d070c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063554256 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063554256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063554256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063554256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063554259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063554260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063554260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063554260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:35:55.213021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2824): Terminating (SIGTERM) 06:35:55.254476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2827): Terminating (SIGTERM) 06:35:55.295981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2830): Terminating (SIGTERM) 06:35:55.337767 --- ParallelTerminationStrategy: PID 2824 died... 06:35:55.357072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2824): Terminated: ok {rc=0} 06:35:55.402863 --- ParallelTerminationStrategy: PID 2827 died... 06:35:55.422263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2827): Terminated: ok {rc=0} 06:35:55.467958 --- ParallelTerminationStrategy: PID 2830 died... 06:35:55.487292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2830): Terminated: ok {rc=0} 06:35:55.574508 bus /sierra_3: Setting Powered False 06:35:56.670449 bus /sierra_3: Setting Powered False 06:35:57.782454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:35:59.031260 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:35:59.039741 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:35:59.072453 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:35:59.099432 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:35:59.152795 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:35:59.186116 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:35:59.213045 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:35:59.763261 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:35:59.814102 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:35:59.825591 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:35:59.893153 tst mo_mt_call.py: using LAC 19610 06:36:00.016643 tst mo_mt_call.py: using RAC 230 06:36:00.143771 tst mo_mt_call.py: using CellId 19610 06:36:00.268558 tst mo_mt_call.py: using BVCI 19611 06:36:00.383666 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:00.395211 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:00.406525 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:00.417944 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:00.429331 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:00.440576 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:36:00.554979 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:36:00.673115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:01.182401 run create_hlr_db(pid=2836): Launched 06:36:01.345818 bus /sierra_2: Setting Powered False 06:36:02.404578 run create_hlr_db(pid=2836): Terminated: ok {rc=0} 06:36:02.831419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2838): Launched 06:36:03.126909 run osmo-hlr_10.42.42.2(pid=2839): Launched 06:36:03.239154 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:03.763382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2841): Launched 06:36:04.059557 run osmo-stp_10.42.42.5(pid=2842): Launched 06:36:04.171628 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:04.705704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2844): Launched 06:36:05.001144 run osmo-msc_10.42.42.6(pid=2845): Launched 06:36:05.166496 run osmo-stp_10.42.42.5(pid=2842): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2842)] 06:36:05.293902 run osmo-stp_10.42.42.5(pid=2842): stdout: | (launched: 2022-12-09_06:36:04.005195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:05.420822 run osmo-stp_10.42.42.5(pid=2842): stderr: | 20221209063604174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063604174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063604174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063604175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063604175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063604175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063604175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:05.545336 run osmo-stp_10.42.42.5(pid=2842): stdout: | (launched: 2022-12-09_06:36:04.005195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:05.663071 run osmo-stp_10.42.42.5(pid=2842): stderr: | 20221209063604174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063604174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063604174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063604175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063604175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063604175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063604175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:05.805031 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2842): Process ended prematurely: osmo-stp_10.42.42.5(pid=2842) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2842)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:36:05.814051 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 06:36:05.841396 run osmo-hlr_10.42.42.2(pid=2839): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2839)] 06:36:05.889748 run osmo-hlr_10.42.42.2(pid=2839): stdout: | (launched: 2022-12-09_06:36:03.072761) 06:36:05.939847 run osmo-hlr_10.42.42.2(pid=2839): stderr: | 20221209063603247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063603248 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063603248 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063603248 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063603248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063603248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063603260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063603268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063603268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063603268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:06.009515 run osmo-msc_10.42.42.6(pid=2845): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2845)] 06:36:06.057484 run osmo-msc_10.42.42.6(pid=2845): stdout: | (launched: 2022-12-09_06:36:04.946765) 06:36:06.107133 run osmo-msc_10.42.42.6(pid=2845): stderr: | 20221209063605218 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063605218 DLGLOBAL DEBUG validating counter group 0x7f6c6a1a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063605218 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063605218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063605218 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063605218 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063605220 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063605221 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063605221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063605221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:06.157230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2838): Terminating (SIGTERM) 06:36:06.197152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2841): Terminating (SIGTERM) 06:36:06.237279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2844): Terminating (SIGTERM) 06:36:06.278139 --- ParallelTerminationStrategy: PID 2838 died... 06:36:06.297204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2838): Terminated: ok {rc=0} 06:36:06.341552 --- ParallelTerminationStrategy: PID 2841 died... 06:36:06.360049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2841): Terminated: ok {rc=0} 06:36:06.405262 --- ParallelTerminationStrategy: PID 2844 died... 06:36:06.423766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2844): Terminated: ok {rc=0} 06:36:06.508892 bus /sierra_3: Setting Powered False 06:36:07.609066 bus /sierra_3: Setting Powered False 06:36:08.723330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:36:09.871061 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:09.883332 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:36:09.951824 tst mo_mt_call_osmux.py: using LAC 19611 06:36:10.076926 tst mo_mt_call_osmux.py: using RAC 231 06:36:10.202235 tst mo_mt_call_osmux.py: using CellId 19611 06:36:10.328874 tst mo_mt_call_osmux.py: using BVCI 19612 06:36:10.444722 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:10.456341 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:10.467609 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:10.478926 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:10.490417 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:36:10.501748 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:36:10.617186 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:36:10.738013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:11.230908 run create_hlr_db(pid=2847): Launched 06:36:11.360137 bus /sierra_2: Setting Powered False 06:36:12.423402 run create_hlr_db(pid=2847): Terminated: ok {rc=0} 06:36:12.847133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2849): Launched 06:36:13.143107 run osmo-hlr_10.42.42.2(pid=2850): Launched 06:36:13.255289 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:13.765341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2852): Launched 06:36:14.063148 run osmo-stp_10.42.42.5(pid=2853): Launched 06:36:14.176645 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:14.711208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2855): Launched 06:36:15.006614 run osmo-msc_10.42.42.6(pid=2856): Launched 06:36:15.171976 run osmo-stp_10.42.42.5(pid=2853): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2853)] 06:36:15.298480 run osmo-stp_10.42.42.5(pid=2853): stdout: | (launched: 2022-12-09_06:36:14.008546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:15.424805 run osmo-stp_10.42.42.5(pid=2853): stderr: | 20221209063614177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063614177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063614177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063614178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063614178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063614178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063614178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:15.548659 run osmo-stp_10.42.42.5(pid=2853): stdout: | (launched: 2022-12-09_06:36:14.008546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:15.666198 run osmo-stp_10.42.42.5(pid=2853): stderr: | 20221209063614177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063614177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063614177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063614178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063614178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063614178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063614178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:15.807700 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2853): Process ended prematurely: osmo-stp_10.42.42.5(pid=2853) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2853)] [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:36:15.816584 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 06:36:15.858781 run osmo-hlr_10.42.42.2(pid=2850): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2850)] 06:36:15.907645 run osmo-hlr_10.42.42.2(pid=2850): stdout: | (launched: 2022-12-09_06:36:13.088563) 06:36:15.957806 run osmo-hlr_10.42.42.2(pid=2850): stderr: | 20221209063613265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063613265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063613265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063613265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063613265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063613265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063613278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063613286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063613286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063613287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:16.027561 run osmo-msc_10.42.42.6(pid=2856): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2856)] 06:36:16.076072 run osmo-msc_10.42.42.6(pid=2856): stdout: | (launched: 2022-12-09_06:36:14.952362) 06:36:16.126345 run osmo-msc_10.42.42.6(pid=2856): stderr: | 20221209063615221 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063615222 DLGLOBAL DEBUG validating counter group 0x7fa9236e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063615222 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063615222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063615222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063615223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063615225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063615225 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063615225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063615225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:16.176915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2849): Terminating (SIGTERM) 06:36:16.218223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2852): Terminating (SIGTERM) 06:36:16.261127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2855): Terminating (SIGTERM) 06:36:16.304109 --- ParallelTerminationStrategy: PID 2849 died... 06:36:16.323490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2849): Terminated: ok {rc=0} 06:36:16.368837 --- ParallelTerminationStrategy: PID 2852 died... 06:36:16.388081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2852): Terminated: ok {rc=0} 06:36:16.433541 --- ParallelTerminationStrategy: PID 2855 died... 06:36:16.452534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2855): Terminated: ok {rc=0} 06:36:16.537500 bus /sierra_3: Setting Powered False 06:36:17.632880 bus /sierra_3: Setting Powered False 06:36:18.748013 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:36:19.992700 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:19.999975 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:36:20.033458 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:36:20.059701 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:36:20.111672 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:36:20.144113 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:36:20.170924 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:36:20.721542 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:36:20.770309 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:20.781434 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:36:20.848452 tst mo_mt_call.py: using LAC 19612 06:36:20.968303 tst mo_mt_call.py: using RAC 232 06:36:21.085855 tst mo_mt_call.py: using CellId 19612 06:36:21.201364 tst mo_mt_call.py: using BVCI 19613 06:36:21.309086 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:21.320349 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:21.331536 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:21.343343 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:21.355298 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:21.367098 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:36:21.481204 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:36:21.598665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:22.060330 run create_hlr_db(pid=2861): Launched 06:36:22.173536 bus /sierra_2: Setting Powered False 06:36:23.232583 run create_hlr_db(pid=2861): Terminated: ok {rc=0} 06:36:23.646635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Launched 06:36:23.942763 run osmo-hlr_10.42.42.2(pid=2864): Launched 06:36:24.056130 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:24.570704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Launched 06:36:24.866433 run osmo-stp_10.42.42.5(pid=2867): Launched 06:36:24.980596 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:25.516446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2869): Launched 06:36:25.813107 run osmo-msc_10.42.42.6(pid=2870): Launched 06:36:25.980253 run osmo-stp_10.42.42.5(pid=2867): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] 06:36:26.107816 run osmo-stp_10.42.42.5(pid=2867): stdout: | (launched: 2022-12-09_06:36:24.812136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:26.234600 run osmo-stp_10.42.42.5(pid=2867): stderr: | 20221209063624980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063624980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063624980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063624981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063624981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063624981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063624981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:26.358698 run osmo-stp_10.42.42.5(pid=2867): stdout: | (launched: 2022-12-09_06:36:24.812136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:26.476439 run osmo-stp_10.42.42.5(pid=2867): stderr: | 20221209063624980 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063624980 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063624980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063624981 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063624981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063624981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063624981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:26.617711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2867): Process ended prematurely: osmo-stp_10.42.42.5(pid=2867) [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:36:26.626632 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 06:36:26.653326 run osmo-hlr_10.42.42.2(pid=2864): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2864)] 06:36:26.701627 run osmo-hlr_10.42.42.2(pid=2864): stdout: | (launched: 2022-12-09_06:36:23.888520) 06:36:26.751143 run osmo-hlr_10.42.42.2(pid=2864): stderr: | 20221209063624063 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063624063 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063624063 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063624063 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063624063 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063624064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063624076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063624084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063624085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063624085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:26.820444 run osmo-msc_10.42.42.6(pid=2870): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2870)] 06:36:26.868441 run osmo-msc_10.42.42.6(pid=2870): stdout: | (launched: 2022-12-09_06:36:25.758386) 06:36:26.918208 run osmo-msc_10.42.42.6(pid=2870): stderr: | 20221209063626030 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063626031 DLGLOBAL DEBUG validating counter group 0x7efcca2e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063626031 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063626031 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063626031 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063626031 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063626033 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063626034 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063626034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063626034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:26.968242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Terminating (SIGTERM) 06:36:27.008345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Terminating (SIGTERM) 06:36:27.048398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2869): Terminating (SIGTERM) 06:36:27.088669 --- ParallelTerminationStrategy: PID 2863 died... 06:36:27.107797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2863): Terminated: ok {rc=0} 06:36:27.152435 --- ParallelTerminationStrategy: PID 2866 died... 06:36:27.171201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2866): Terminated: ok {rc=0} 06:36:27.215537 --- ParallelTerminationStrategy: PID 2869 died... 06:36:27.234091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2869): Terminated: ok {rc=0} 06:36:27.319450 bus /sierra_3: Setting Powered False 06:36:28.418664 bus /sierra_3: Setting Powered False 06:36:29.531891 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:36:30.679963 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:30.692413 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:36:30.761586 tst mo_mt_call_osmux.py: using LAC 19613 06:36:30.893322 tst mo_mt_call_osmux.py: using RAC 233 06:36:31.032405 tst mo_mt_call_osmux.py: using CellId 19613 06:36:31.164084 tst mo_mt_call_osmux.py: using BVCI 19614 06:36:31.297408 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:31.309797 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:31.321876 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:31.334653 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:31.348715 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:36:31.360724 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:36:31.480035 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:36:31.616210 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:32.194765 run create_hlr_db(pid=2872): Launched 06:36:32.358173 bus /sierra_2: Setting Powered False 06:36:33.417997 run create_hlr_db(pid=2872): Terminated: ok {rc=0} 06:36:33.832359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2874): Launched 06:36:34.128365 run osmo-hlr_10.42.42.2(pid=2875): Launched 06:36:34.241259 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:34.749895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2877): Launched 06:36:35.046149 run osmo-stp_10.42.42.5(pid=2878): Launched 06:36:35.159105 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:35.694535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2880): Launched 06:36:35.992341 run osmo-msc_10.42.42.6(pid=2881): Launched 06:36:36.159219 run osmo-stp_10.42.42.5(pid=2878): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2878)] 06:36:36.285682 run osmo-stp_10.42.42.5(pid=2878): stdout: | (launched: 2022-12-09_06:36:34.991818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:36.411515 run osmo-stp_10.42.42.5(pid=2878): stderr: | 20221209063635160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063635160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063635161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063635161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063635161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063635162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063635162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:36.536103 run osmo-stp_10.42.42.5(pid=2878): stdout: | (launched: 2022-12-09_06:36:34.991818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:36.654533 run osmo-stp_10.42.42.5(pid=2878): stderr: | 20221209063635160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063635160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063635161 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063635161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063635161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063635162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063635162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:36.796341 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2878): Process ended prematurely: osmo-stp_10.42.42.5(pid=2878) [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2878)] [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:36:36.805321 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:36:36.832655 run osmo-hlr_10.42.42.2(pid=2875): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2875)] 06:36:36.880755 run osmo-hlr_10.42.42.2(pid=2875): stdout: | (launched: 2022-12-09_06:36:34.074561) 06:36:36.930748 run osmo-hlr_10.42.42.2(pid=2875): stderr: | 20221209063634247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063634247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063634247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063634247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063634248 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063634248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063634260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063634268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063634269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063634269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:37.000482 run osmo-msc_10.42.42.6(pid=2881): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2881)] 06:36:37.048552 run osmo-msc_10.42.42.6(pid=2881): stdout: | (launched: 2022-12-09_06:36:35.937648) 06:36:37.098008 run osmo-msc_10.42.42.6(pid=2881): stderr: | 20221209063636209 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063636209 DLGLOBAL DEBUG validating counter group 0x7f4d7fb98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063636210 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063636210 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063636210 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063636210 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063636212 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063636214 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063636214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063636214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:37.148387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2874): Terminating (SIGTERM) 06:36:37.188321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2877): Terminating (SIGTERM) 06:36:37.228590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2880): Terminating (SIGTERM) 06:36:37.269002 --- ParallelTerminationStrategy: PID 2874 died... 06:36:37.288098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2874): Terminated: ok {rc=0} 06:36:37.332871 --- ParallelTerminationStrategy: PID 2877 died... 06:36:37.351671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2877): Terminated: ok {rc=0} 06:36:37.396338 --- ParallelTerminationStrategy: PID 2880 died... 06:36:37.415158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2880): Terminated: ok {rc=0} 06:36:37.501449 bus /sierra_3: Setting Powered False 06:36:38.604043 bus /sierra_3: Setting Powered False 06:36:39.721232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:36:40.966301 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:36:40.973111 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:36:41.005597 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 06:36:41.032111 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 06:36:41.083427 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:36:41.115792 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 06:36:41.141985 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 06:36:41.693405 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 06:36:41.741965 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:41.753436 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:36:41.802674 tst mo_mt_call.py: using LAC 19614 06:36:41.921570 tst mo_mt_call.py: using RAC 234 06:36:42.048391 tst mo_mt_call.py: using CellId 19614 06:36:42.167476 tst mo_mt_call.py: using BVCI 19615 06:36:42.282387 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:42.294397 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:42.306126 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:42.317923 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:42.329791 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:42.341535 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:42.455590 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:42.569974 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:43.029165 run create_hlr_db(pid=2886): Launched 06:36:43.142913 bus /sierra_2: Setting Powered False 06:36:44.202895 run create_hlr_db(pid=2886): Terminated: ok {rc=0} 06:36:44.617973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2888): Launched 06:36:44.914470 run osmo-hlr_10.42.42.2(pid=2889): Launched 06:36:45.027050 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:45.538531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2891): Launched 06:36:45.847214 run osmo-stp_10.42.42.5(pid=2892): Launched 06:36:46.063232 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:46.768763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2894): Launched 06:36:47.101873 run osmo-msc_10.42.42.6(pid=2895): Launched 06:36:47.314256 run osmo-stp_10.42.42.5(pid=2892): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2892)] 06:36:47.463502 run osmo-stp_10.42.42.5(pid=2892): stdout: | (launched: 2022-12-09_06:36:45.780828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:47.601669 run osmo-stp_10.42.42.5(pid=2892): stderr: | 20221209063646032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063646033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063646033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063646033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063646034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063646034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063646034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:47.739324 run osmo-stp_10.42.42.5(pid=2892): stdout: | (launched: 2022-12-09_06:36:45.780828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:47.865774 run osmo-stp_10.42.42.5(pid=2892): stderr: | 20221209063646032 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063646033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063646033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063646033 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063646034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063646034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063646034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:48.017706 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2892): Process ended prematurely: osmo-stp_10.42.42.5(pid=2892) [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2892)] [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 06:36:48.027503 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 06:36:48.055990 run osmo-hlr_10.42.42.2(pid=2889): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2889)] 06:36:48.106182 run osmo-hlr_10.42.42.2(pid=2889): stdout: | (launched: 2022-12-09_06:36:44.860114) 06:36:48.158335 run osmo-hlr_10.42.42.2(pid=2889): stderr: | 20221209063645033 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063645033 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063645033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063645033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063645033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063645034 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063645046 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063645054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063645054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063645054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:48.230631 run osmo-msc_10.42.42.6(pid=2895): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2895)] 06:36:48.280592 run osmo-msc_10.42.42.6(pid=2895): stdout: | (launched: 2022-12-09_06:36:47.033051) 06:36:48.332281 run osmo-msc_10.42.42.6(pid=2895): stderr: | 20221209063647482 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063647483 DLGLOBAL DEBUG validating counter group 0x7fdb22f5bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063647483 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063647483 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063647483 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063647483 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063647485 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063647485 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063647485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063647485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:48.384777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2888): Terminating (SIGTERM) 06:36:48.426692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2891): Terminating (SIGTERM) 06:36:48.468809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2894): Terminating (SIGTERM) 06:36:48.511257 --- ParallelTerminationStrategy: PID 2888 died... 06:36:48.531405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2888): Terminated: ok {rc=0} 06:36:48.578141 --- ParallelTerminationStrategy: PID 2891 died... 06:36:48.598086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2891): Terminated: ok {rc=0} 06:36:48.644654 --- ParallelTerminationStrategy: PID 2894 died... 06:36:48.664321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2894): Terminated: ok {rc=0} 06:36:48.752354 bus /sierra_3: Setting Powered False 06:36:49.853318 bus /sierra_3: Setting Powered False 06:36:50.969905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 06:36:52.119287 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.131798 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:36:52.183566 tst mo_mt_call_osmux.py: using LAC 19615 06:36:52.309842 tst mo_mt_call_osmux.py: using RAC 235 06:36:52.437965 tst mo_mt_call_osmux.py: using CellId 19615 06:36:52.563674 tst mo_mt_call_osmux.py: using BVCI 19616 06:36:52.680036 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.691910 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.703572 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.715161 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.726942 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 06:36:52.738547 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:52.858350 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 06:36:52.973761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:36:53.434368 run create_hlr_db(pid=2897): Launched 06:36:53.547927 bus /sierra_2: Setting Powered False 06:36:54.607935 run create_hlr_db(pid=2897): Terminated: ok {rc=0} 06:36:55.044125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Launched 06:36:55.363428 run osmo-hlr_10.42.42.2(pid=2900): Launched 06:36:55.485658 run osmo-stp_10.42.42.5: Starting osmo-stp 06:36:56.040464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Launched 06:36:56.360613 run osmo-stp_10.42.42.5(pid=2903): Launched 06:36:56.482603 run osmo-msc_10.42.42.6: Starting osmo-msc 06:36:57.058071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2905): Launched 06:36:57.376216 run osmo-msc_10.42.42.6(pid=2906): Launched 06:36:57.555106 run osmo-stp_10.42.42.5(pid=2903): ERR: Terminated: ERROR {rc=1} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] 06:36:57.691247 run osmo-stp_10.42.42.5(pid=2903): stdout: | (launched: 2022-12-09_06:36:56.302696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:57.826732 run osmo-stp_10.42.42.5(pid=2903): stderr: | 20221209063656496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063656496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063656496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063656497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063656497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063656497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063656497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:57.961275 run osmo-stp_10.42.42.5(pid=2903): stdout: | (launched: 2022-12-09_06:36:56.302696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:36:58.088600 run osmo-stp_10.42.42.5(pid=2903): stderr: | 20221209063656496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063656496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063656496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063656497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063656497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063656497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063656497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:36:58.241191 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2903): Process ended prematurely: osmo-stp_10.42.42.5(pid=2903) [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 06:36:58.250775 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:36:58.279021 run osmo-hlr_10.42.42.2(pid=2900): ERR: Terminated: ERROR {rc=237} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2900)] 06:36:58.329208 run osmo-hlr_10.42.42.2(pid=2900): stdout: | (launched: 2022-12-09_06:36:55.305270) 06:36:58.381229 run osmo-hlr_10.42.42.2(pid=2900): stderr: | 20221209063655504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063655504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063655504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063655504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063655504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063655504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063655516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063655524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063655525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063655525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:36:58.453558 run osmo-msc_10.42.42.6(pid=2906): ERR: Terminated: ERROR {rc=2} [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2906)] 06:36:58.503485 run osmo-msc_10.42.42.6(pid=2906): stdout: | (launched: 2022-12-09_06:36:57.317894) 06:36:58.554976 run osmo-msc_10.42.42.6(pid=2906): stderr: | 20221209063657642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063657642 DLGLOBAL DEBUG validating counter group 0x7ff7eaaaac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063657643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063657643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063657643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063657643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063657645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063657645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063657645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063657645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:36:58.606829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Terminating (SIGTERM) 06:36:58.648417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Terminating (SIGTERM) 06:36:58.690165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2905): Terminating (SIGTERM) 06:36:58.732400 --- ParallelTerminationStrategy: PID 2899 died... 06:36:58.752458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2899): Terminated: ok {rc=0} 06:36:58.799579 --- ParallelTerminationStrategy: PID 2902 died... 06:36:58.819483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2902): Terminated: ok {rc=0} 06:36:58.866529 --- ParallelTerminationStrategy: PID 2905 died... 06:36:58.886431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2905): Terminated: ok {rc=0} 06:36:58.975134 bus /sierra_3: Setting Powered False 06:37:00.074888 bus /sierra_3: Setting Powered False 06:37:01.190252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 emergency:nanobts+band-900 --------------------------------------------------------------------- 06:37:02.440242 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:02.445568 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:37:02.477392 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 06:37:02.503454 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:37:02.586095 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:37:02.617644 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 06:37:02.643721 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:37:03.227029 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2355 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 06:37:03.231914 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.242561 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:03.289341 tst emergency_mo_mt_call.py: using LAC 19616 06:37:03.403563 tst emergency_mo_mt_call.py: using RAC 236 06:37:03.525817 tst emergency_mo_mt_call.py: using CellId 19616 06:37:03.640833 tst emergency_mo_mt_call.py: using BVCI 19617 06:37:03.746225 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.756856 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.767317 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.778061 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.788719 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:03.799429 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:03.915712 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:04.032837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:04.520901 run create_hlr_db(pid=2913): Launched 06:37:04.649263 bus /sierra_2: Setting Powered False 06:37:05.711542 run create_hlr_db(pid=2913): Terminated: ok {rc=0} 06:37:06.131496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Launched 06:37:06.423743 run osmo-hlr_10.42.42.2(pid=2916): Launched 06:37:06.533835 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:07.035267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Launched 06:37:07.325443 run osmo-stp_10.42.42.5(pid=2919): Launched 06:37:07.446058 tst emergency_mo_mt_call.py: using MSISDN 7063 06:37:07.599491 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:08.122396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Launched 06:37:08.413584 run osmo-msc_10.42.42.6(pid=2922): Launched 06:37:08.576770 run osmo-stp_10.42.42.5(pid=2919): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] 06:37:08.701348 run osmo-stp_10.42.42.5(pid=2919): stdout: | (launched: 2022-12-09_06:37:07.272508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:08.826515 run osmo-stp_10.42.42.5(pid=2919): stderr: | 20221209063707442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063707442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063707443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063707444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063707446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063707446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063707446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:08.948290 run osmo-stp_10.42.42.5(pid=2919): stdout: | (launched: 2022-12-09_06:37:07.272508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:09.064169 run osmo-stp_10.42.42.5(pid=2919): stderr: | 20221209063707442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063707442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063707443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063707444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063707446 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063707446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063707446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:09.202971 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2919): Process ended prematurely: osmo-stp_10.42.42.5(pid=2919) [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 06:37:09.211252 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 06:37:09.237570 run osmo-hlr_10.42.42.2(pid=2916): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2916)] 06:37:09.285278 run osmo-hlr_10.42.42.2(pid=2916): stdout: | (launched: 2022-12-09_06:37:06.369978) 06:37:09.334790 run osmo-hlr_10.42.42.2(pid=2916): stderr: | 20221209063706542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063706543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063706543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063706543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063706543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063706543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063706555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063706565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063706565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063706565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:09.403890 run osmo-msc_10.42.42.6(pid=2922): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2922)] 06:37:09.451694 run osmo-msc_10.42.42.6(pid=2922): stdout: | (launched: 2022-12-09_06:37:08.360277) 06:37:09.501108 run osmo-msc_10.42.42.6(pid=2922): stderr: | 20221209063708630 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063708630 DLGLOBAL DEBUG validating counter group 0x7f3c4049ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063708630 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063708630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063708630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063708631 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063708634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063708635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063708635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063708635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:09.550820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Terminating (SIGTERM) 06:37:09.590638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Terminating (SIGTERM) 06:37:09.630567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Terminating (SIGTERM) 06:37:09.670712 --- ParallelTerminationStrategy: PID 2915 died... 06:37:09.689811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Terminated: ok {rc=0} 06:37:09.734054 --- ParallelTerminationStrategy: PID 2918 died... 06:37:09.752627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Terminated: ok {rc=0} 06:37:09.797114 --- ParallelTerminationStrategy: PID 2921 died... 06:37:09.815780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Terminated: ok {rc=0} 06:37:09.898727 bus /sierra_3: Setting Powered False 06:37:10.996510 bus /sierra_3: Setting Powered False 06:37:12.115326 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 06:37:13.202030 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.213228 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:13.261778 tst emergency_preemptive_call.py: using LAC 19617 06:37:13.377560 tst emergency_preemptive_call.py: using RAC 237 06:37:13.492863 tst emergency_preemptive_call.py: using CellId 19617 06:37:13.606913 tst emergency_preemptive_call.py: using BVCI 19618 06:37:13.712205 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.722971 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.733473 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.744182 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.754931 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 06:37:13.765644 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:13.881801 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:13.997887 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:14.110496 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:14.220730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:14.675388 run create_hlr_db(pid=2924): Launched 06:37:14.785946 bus /sierra_2: Setting Powered False 06:37:15.850665 run create_hlr_db(pid=2924): Terminated: ok {rc=0} 06:37:16.279842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2926): Launched 06:37:16.603293 run osmo-hlr_10.42.42.2(pid=2927): Launched 06:37:16.872576 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:17.508598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2929): Launched 06:37:17.801758 run osmo-stp_10.42.42.5(pid=2930): Launched 06:37:17.923617 tst emergency_preemptive_call.py: using MSISDN 7064 06:37:18.073210 run osmo-msc_10.42.42.6: Starting osmo-msc 06:37:18.598375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2932): Launched 06:37:18.890016 run osmo-msc_10.42.42.6(pid=2933): Launched 06:37:19.053469 run osmo-stp_10.42.42.5(pid=2930): ERR: Terminated: ERROR {rc=1} [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2930)] 06:37:19.178598 run osmo-stp_10.42.42.5(pid=2930): stdout: | (launched: 2022-12-09_06:37:17.748227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:19.304274 run osmo-stp_10.42.42.5(pid=2930): stderr: | 20221209063717915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063717915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063717915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063717916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063717917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063717917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063717917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:19.427325 run osmo-stp_10.42.42.5(pid=2930): stdout: | (launched: 2022-12-09_06:37:17.748227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:19.543936 run osmo-stp_10.42.42.5(pid=2930): stderr: | 20221209063717915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063717915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063717915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063717916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063717917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063717917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063717917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:19.683559 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2930): Process ended prematurely: osmo-stp_10.42.42.5(pid=2930) [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2930)] [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 06:37:19.691824 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 06:37:19.718643 run osmo-hlr_10.42.42.2(pid=2927): ERR: Terminated: ERROR {rc=237} [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2927)] 06:37:19.767011 run osmo-hlr_10.42.42.2(pid=2927): stdout: | (launched: 2022-12-09_06:37:16.534795) 06:37:19.817408 run osmo-hlr_10.42.42.2(pid=2927): stderr: | 20221209063716805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063716805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063716805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063716806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063716806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063716806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063716823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063716841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063716841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063716841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:19.887563 run osmo-msc_10.42.42.6(pid=2933): ERR: Terminated: ERROR {rc=2} [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2933)] 06:37:19.936292 run osmo-msc_10.42.42.6(pid=2933): stdout: | (launched: 2022-12-09_06:37:18.836489) 06:37:19.986299 run osmo-msc_10.42.42.6(pid=2933): stderr: | 20221209063719104 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209063719104 DLGLOBAL DEBUG validating counter group 0x7f570a9b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209063719104 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209063719105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209063719105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209063719105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209063719107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209063719107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209063719107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209063719108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:37:20.036537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2926): Terminating (SIGTERM) 06:37:20.077252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2929): Terminating (SIGTERM) 06:37:20.117951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2932): Terminating (SIGTERM) 06:37:20.158793 --- ParallelTerminationStrategy: PID 2926 died... 06:37:20.177928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2926): Terminated: ok {rc=0} 06:37:20.222594 --- ParallelTerminationStrategy: PID 2929 died... 06:37:20.241281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2929): Terminated: ok {rc=0} 06:37:20.286020 --- ParallelTerminationStrategy: PID 2932 died... 06:37:20.305053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2932): Terminated: ok {rc=0} 06:37:20.389136 bus /sierra_9: Setting Powered False 06:37:21.487146 bus /sierra_9: Setting Powered False 06:37:22.604024 bus /sierra_8: Setting Powered False 06:37:23.702118 bus /sierra_8: Setting Powered False 06:37:24.818265 bus /sierra_3: Setting Powered False 06:37:25.916613 bus /sierra_3: Setting Powered False 06:37:27.032327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900 --------------------------------------------------------------------- 06:37:28.318284 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:37:28.323883 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 06:37:28.357188 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 06:37:28.396273 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 06:37:28.482508 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 06:37:28.515136 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 06:37:28.553845 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 06:37:29.149821 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 06:37:29.201428 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.212398 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:29.259695 tst cs_paging_gprs_active.py: using LAC 19618 06:37:29.384658 tst cs_paging_gprs_active.py: using RAC 238 06:37:29.509176 tst cs_paging_gprs_active.py: using CellId 19618 06:37:29.632876 tst cs_paging_gprs_active.py: using BVCI 19619 06:37:29.748810 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.759907 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.770771 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.781650 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.792333 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.803218 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.814302 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.825090 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:29.836028 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:29.949489 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:30.066507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:37:30.266095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:30.565529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2938): Launched 06:37:30.825250 run iperf3-srv_10.42.42.10(pid=2939): Launched 06:37:30.965754 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:37:31.210974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:31.547341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2940): Launched 06:37:31.869583 run iperf3-srv_10.42.42.10(pid=2941): Launched 06:37:32.005308 tst cs_paging_gprs_active.py:38: start network... 06:37:32.226249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:32.722812 run create_hlr_db(pid=2942): Launched 06:37:32.852361 bus /sierra_2: Setting Powered False 06:37:33.915998 run create_hlr_db(pid=2942): Terminated: ok {rc=0} 06:37:34.362101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2944): Launched 06:37:34.681958 run osmo-hlr_10.42.42.2(pid=2945): Launched 06:37:34.802836 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:35.352284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2947): Launched 06:37:35.671262 run osmo-stp_10.42.42.5(pid=2948): Launched 06:37:35.795785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:36.350602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2953): Launched 06:37:36.473239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:36.742591 run patchelf(pid=2954): Launched 06:37:36.920207 run osmo-stp_10.42.42.5(pid=2948): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2948)] 06:37:37.055614 run osmo-stp_10.42.42.5(pid=2948): stdout: | (launched: 2022-12-09_06:37:35.613275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:37.193275 run osmo-stp_10.42.42.5(pid=2948): stderr: | 20221209063735813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063735813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063735814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063735814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063735814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063735815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063735815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:37.330420 run osmo-stp_10.42.42.5(pid=2948): stdout: | (launched: 2022-12-09_06:37:35.613275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:37.461453 run osmo-stp_10.42.42.5(pid=2948): stderr: | 20221209063735813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063735813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063735814 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063735814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063735814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063735815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063735815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:37.617175 run patchelf(pid=2954): Terminating (SIGINT) 06:37:37.796215 run patchelf(pid=2954): Terminated: ok {rc=0} 06:37:37.925577 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2948): Process ended prematurely: osmo-stp_10.42.42.5(pid=2948) [trial-2355↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2948)] [trial-2355↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 06:37:37.935610 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:37:37.963840 run osmo-hlr_10.42.42.2(pid=2945): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2945)] 06:37:38.013417 run osmo-hlr_10.42.42.2(pid=2945): stdout: | (launched: 2022-12-09_06:37:34.623915) 06:37:38.064880 run osmo-hlr_10.42.42.2(pid=2945): stderr: | 20221209063734822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063734822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063734822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063734822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063734822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063734822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063734834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063734843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063734843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063734843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:38.117199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2938): Terminating (SIGTERM) 06:37:38.158815 run iperf3-srv_10.42.42.10(pid=2939): Terminating (SIGTERM) 06:37:38.200433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2940): Terminating (SIGTERM) 06:37:38.242066 run iperf3-srv_10.42.42.10(pid=2941): Terminating (SIGTERM) 06:37:38.283337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2944): Terminating (SIGTERM) 06:37:38.324884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2947): Terminating (SIGTERM) 06:37:38.366368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2953): Terminating (SIGTERM) 06:37:38.408047 --- ParallelTerminationStrategy: PID 2938 died... 06:37:38.428332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2938): Terminated: ok {rc=0} 06:37:38.474523 --- ParallelTerminationStrategy: PID 2939 died... 06:37:38.493932 run iperf3-srv_10.42.42.10(pid=2939): Terminated {rc=256} 06:37:38.539470 --- ParallelTerminationStrategy: PID 2940 died... 06:37:38.558931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2940): Terminated: ok {rc=0} 06:37:38.604559 --- ParallelTerminationStrategy: PID 2941 died... 06:37:38.623996 run iperf3-srv_10.42.42.10(pid=2941): Terminated {rc=256} 06:37:38.669527 --- ParallelTerminationStrategy: PID 2944 died... 06:37:38.688884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2944): Terminated: ok {rc=0} 06:37:38.734679 --- ParallelTerminationStrategy: PID 2947 died... 06:37:38.754216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2947): Terminated: ok {rc=0} 06:37:38.799795 --- ParallelTerminationStrategy: PID 2953 died... 06:37:38.819347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2953): Terminated: ok {rc=0} 06:37:38.905678 bus /gobi_0: Setting Powered False 06:37:40.004861 bus /gobi_0: Setting Powered False 06:37:41.118533 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 06:37:42.266885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.278473 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:42.328803 tst iperf3.py: using LAC 19619 06:37:42.453655 tst iperf3.py: using RAC 239 06:37:42.572357 tst iperf3.py: using CellId 19619 06:37:42.691489 tst iperf3.py: using BVCI 19620 06:37:42.800716 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.811412 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.821937 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.832632 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.843235 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.853885 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.864627 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.875268 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:42.886033 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:43.003732 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:37:43.219617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:43.538972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Launched 06:37:43.816929 run iperf3-srv_10.42.42.10(pid=2956): Launched 06:37:43.936606 tst iperf3.py:8: start network... 06:37:44.152177 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:44.648419 run create_hlr_db(pid=2957): Launched 06:37:44.778725 bus /gobi_6: Setting Powered False 06:37:45.845843 run create_hlr_db(pid=2957): Terminated: ok {rc=0} 06:37:46.293552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Launched 06:37:46.618936 run osmo-hlr_10.42.42.2(pid=2960): Launched 06:37:46.864463 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:47.466335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Launched 06:37:47.765694 run osmo-stp_10.42.42.5(pid=2963): Launched 06:37:47.879331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:37:48.394984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Launched 06:37:48.509769 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:37:48.763245 run patchelf(pid=2966): Launched 06:37:48.930095 run osmo-stp_10.42.42.5(pid=2963): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] 06:37:49.056718 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_06:37:47.711407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:49.185190 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209063747881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063747881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063747881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063747882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063747882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063747882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063747882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:49.313098 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_06:37:47.711407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:37:49.436113 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209063747881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063747881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063747881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063747882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063747882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063747882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063747882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:37:49.581597 run patchelf(pid=2966): Terminating (SIGINT) 06:37:49.749529 run patchelf(pid=2966): Terminated: ok {rc=0} 06:37:49.870603 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2355↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] [trial-2355↪gprs:nanobts+band-900↪iperf3.py:8] 06:37:49.879893 tst iperf3.py:8: Test FAILED (7.7 sec) 06:37:49.907846 run osmo-hlr_10.42.42.2(pid=2960): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2960)] 06:37:49.956198 run osmo-hlr_10.42.42.2(pid=2960): stdout: | (launched: 2022-12-09_06:37:46.549400) 06:37:50.006365 run osmo-hlr_10.42.42.2(pid=2960): stderr: | 20221209063746859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063746859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063746859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063746859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063746859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063746859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063746875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063746901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063746901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063746901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:37:50.057130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Terminating (SIGTERM) 06:37:50.098078 run iperf3-srv_10.42.42.10(pid=2956): Terminating (SIGTERM) 06:37:50.138625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminating (SIGTERM) 06:37:50.179341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminating (SIGTERM) 06:37:50.219790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Terminating (SIGTERM) 06:37:50.260720 --- ParallelTerminationStrategy: PID 2955 died... 06:37:50.280107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Terminated: ok {rc=0} 06:37:50.325092 --- ParallelTerminationStrategy: PID 2956 died... 06:37:50.343819 run iperf3-srv_10.42.42.10(pid=2956): Terminated {rc=256} 06:37:50.388467 --- ParallelTerminationStrategy: PID 2959 died... 06:37:50.407316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminated: ok {rc=0} 06:37:50.451983 --- ParallelTerminationStrategy: PID 2962 died... 06:37:50.470815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminated: ok {rc=0} 06:37:50.515837 --- ParallelTerminationStrategy: PID 2965 died... 06:37:50.534973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Terminated: ok {rc=0} 06:37:50.622212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 06:37:51.769957 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:51.781191 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:37:51.829255 tst iperf3m4.py: using LAC 19620 06:37:51.947584 tst iperf3m4.py: using RAC 240 06:37:52.076192 tst iperf3m4.py: using CellId 19620 06:37:52.203708 tst iperf3m4.py: using BVCI 19621 06:37:52.313196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.323882 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.334303 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.344911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.355434 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.366006 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.376593 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.387075 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:37:52.397632 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:52.517751 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:52.635636 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:52.752830 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:37:52.871332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:37:53.071344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:53.370962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Launched 06:37:53.631638 run iperf3-srv_10.42.42.10(pid=2968): Launched 06:37:53.744073 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:37:53.943716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:54.243058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2969): Launched 06:37:54.502720 run iperf3-srv_10.42.42.10(pid=2970): Launched 06:37:54.615048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:37:54.813823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:55.112784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2971): Launched 06:37:55.372125 run iperf3-srv_10.42.42.10(pid=2972): Launched 06:37:55.483975 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:37:55.682496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:37:55.981583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2973): Launched 06:37:56.242090 run iperf3-srv_10.42.42.10(pid=2974): Launched 06:37:56.354120 tst iperf3m4.py:8: start network... 06:37:56.554340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:37:57.017542 run create_hlr_db(pid=2975): Launched 06:37:57.132004 bus /gobi_6: Setting Powered False 06:37:58.191352 run create_hlr_db(pid=2975): Terminated: ok {rc=0} 06:37:58.609658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2977): Launched 06:37:58.909735 run osmo-hlr_10.42.42.2(pid=2978): Launched 06:37:59.024055 run osmo-stp_10.42.42.5: Starting osmo-stp 06:37:59.553380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2980): Launched 06:37:59.855071 run osmo-stp_10.42.42.5(pid=2981): Launched 06:37:59.969085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:00.484393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2983): Launched 06:38:00.599538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:00.851536 run patchelf(pid=2984): Launched 06:38:01.070382 run osmo-stp_10.42.42.5(pid=2981): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2981)] 06:38:01.255849 run osmo-stp_10.42.42.5(pid=2981): stdout: | (launched: 2022-12-09_06:37:59.799716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:01.417548 run osmo-stp_10.42.42.5(pid=2981): stderr: | 20221209063759965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063759965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063759965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063759966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063759966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063759966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063759966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:01.564658 run osmo-stp_10.42.42.5(pid=2981): stdout: | (launched: 2022-12-09_06:37:59.799716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:01.718775 run osmo-stp_10.42.42.5(pid=2981): stderr: | 20221209063759965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063759965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063759965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063759966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063759966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063759966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063759966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:01.888693 run patchelf(pid=2984): Terminating (SIGINT) 06:38:02.076482 run patchelf(pid=2984): Terminated: ok {rc=0} 06:38:02.202540 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2981): Process ended prematurely: osmo-stp_10.42.42.5(pid=2981) [trial-2355↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2981)] [trial-2355↪gprs:nanobts+band-900↪iperf3m4.py:8] 06:38:02.213229 tst iperf3m4.py:8: Test FAILED (10.5 sec) 06:38:02.244712 run osmo-hlr_10.42.42.2(pid=2978): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2978)] 06:38:02.295758 run osmo-hlr_10.42.42.2(pid=2978): stdout: | (launched: 2022-12-09_06:37:58.854535) 06:38:02.356372 run osmo-hlr_10.42.42.2(pid=2978): stderr: | 20221209063759025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063759025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063759025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063759025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063759026 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063759026 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063759038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063759046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063759046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063759047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:02.422450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Terminating (SIGTERM) 06:38:02.470274 run iperf3-srv_10.42.42.10(pid=2968): Terminating (SIGTERM) 06:38:02.522413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2969): Terminating (SIGTERM) 06:38:02.582494 run iperf3-srv_10.42.42.10(pid=2970): Terminating (SIGTERM) 06:38:02.639205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2971): Terminating (SIGTERM) 06:38:02.686233 run iperf3-srv_10.42.42.10(pid=2972): Terminating (SIGTERM) 06:38:02.728814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2973): Terminating (SIGTERM) 06:38:02.773548 run iperf3-srv_10.42.42.10(pid=2974): Terminating (SIGTERM) 06:38:02.816132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2977): Terminating (SIGTERM) 06:38:02.868191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2980): Terminating (SIGTERM) 06:38:02.911771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2983): Terminating (SIGTERM) 06:38:02.962255 --- ParallelTerminationStrategy: PID 2967 died... 06:38:02.983853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Terminated: ok {rc=0} 06:38:03.032195 --- ParallelTerminationStrategy: PID 2968 died... 06:38:03.052141 run iperf3-srv_10.42.42.10(pid=2968): Terminated {rc=256} 06:38:03.107987 --- ParallelTerminationStrategy: PID 2969 died... 06:38:03.128737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2969): Terminated: ok {rc=0} 06:38:03.180234 --- ParallelTerminationStrategy: PID 2970 died... 06:38:03.203304 run iperf3-srv_10.42.42.10(pid=2970): Terminated {rc=256} 06:38:03.251310 --- ParallelTerminationStrategy: PID 2971 died... 06:38:03.271208 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2971): Terminated: ok {rc=0} 06:38:03.323037 --- ParallelTerminationStrategy: PID 2972 died... 06:38:03.342691 run iperf3-srv_10.42.42.10(pid=2972): Terminated {rc=256} 06:38:03.401970 --- ParallelTerminationStrategy: PID 2973 died... 06:38:03.423940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2973): Terminated: ok {rc=0} 06:38:03.483686 --- ParallelTerminationStrategy: PID 2974 died... 06:38:03.508064 run iperf3-srv_10.42.42.10(pid=2974): Terminated {rc=256} 06:38:03.567272 --- ParallelTerminationStrategy: PID 2977 died... 06:38:03.589431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2977): Terminated: ok {rc=0} 06:38:03.650673 --- ParallelTerminationStrategy: PID 2980 died... 06:38:03.677994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2980): Terminated: ok {rc=0} 06:38:03.734078 --- ParallelTerminationStrategy: PID 2983 died... 06:38:03.759276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2983): Terminated: ok {rc=0} 06:38:03.860633 bus /gobi_4: Setting Powered False 06:38:04.977582 bus /gobi_4: Setting Powered False 06:38:06.097268 bus /gobi_1: Setting Powered False 06:38:07.196133 bus /gobi_1: Setting Powered False 06:38:08.313366 bus /gobi_0: Setting Powered False 06:38:09.414641 bus /gobi_0: Setting Powered False 06:38:10.576880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900 ping.py ---------------------------------------------- 06:38:11.715646 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:11.728533 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:38:11.779387 tst ping.py: using LAC 19621 06:38:11.909461 tst ping.py: using RAC 241 06:38:12.036108 tst ping.py: using CellId 19621 06:38:12.160524 tst ping.py: using BVCI 19622 06:38:12.278521 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.290409 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.302285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.314026 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.325678 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.337278 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.349151 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:12.360779 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:12.483405 tst ping.py:19: start network... 06:38:12.703016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:13.212727 run create_hlr_db(pid=3305): Launched 06:38:13.376628 bus /gobi_6: Setting Powered False 06:38:14.442083 run create_hlr_db(pid=3305): Terminated: ok {rc=0} 06:38:14.903902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Launched 06:38:15.249627 run osmo-hlr_10.42.42.2(pid=3308): Launched 06:38:15.492765 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:16.193891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Launched 06:38:16.601673 run osmo-stp_10.42.42.5(pid=3311): Launched 06:38:16.886470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:17.608404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3313): Launched 06:38:17.756621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:18.087829 run patchelf(pid=3314): Launched 06:38:18.317381 run osmo-stp_10.42.42.5(pid=3311): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] 06:38:18.478740 run osmo-stp_10.42.42.5(pid=3311): stdout: | (launched: 2022-12-09_06:38:16.525361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:18.619568 run osmo-stp_10.42.42.5(pid=3311): stderr: | 20221209063816863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063816863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063816864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063816864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063816871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063816871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063816871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:18.759380 run osmo-stp_10.42.42.5(pid=3311): stdout: | (launched: 2022-12-09_06:38:16.525361) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:18.893390 run osmo-stp_10.42.42.5(pid=3311): stderr: | 20221209063816863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063816863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063816864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063816864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063816871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063816871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063816871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:19.052084 run patchelf(pid=3314): Terminating (SIGINT) 06:38:19.235900 run patchelf(pid=3314): Terminated: ok {rc=0} 06:38:19.367506 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3311): Process ended prematurely: osmo-stp_10.42.42.5(pid=3311) [trial-2355↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] [trial-2355↪gprs:nanobts+band-900↪ping.py:22] 06:38:19.377785 tst ping.py:22: Test FAILED (7.7 sec) 06:38:19.407590 run osmo-hlr_10.42.42.2(pid=3308): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3308)] 06:38:19.461833 run osmo-hlr_10.42.42.2(pid=3308): stdout: | (launched: 2022-12-09_06:38:15.180527) 06:38:19.515702 run osmo-hlr_10.42.42.2(pid=3308): stderr: | 20221209063815488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063815488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063815488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063815488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063815488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063815488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063815507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063815523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063815524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063815524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:19.570013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Terminating (SIGTERM) 06:38:19.614199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Terminating (SIGTERM) 06:38:19.660873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3313): Terminating (SIGTERM) 06:38:19.707543 --- ParallelTerminationStrategy: PID 3307 died... 06:38:19.728135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3307): Terminated: ok {rc=0} 06:38:19.777603 --- ParallelTerminationStrategy: PID 3310 died... 06:38:19.798323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3310): Terminated: ok {rc=0} 06:38:19.847930 --- ParallelTerminationStrategy: PID 3313 died... 06:38:19.868848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3313): Terminated: ok {rc=0} 06:38:19.960110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 06:38:21.053465 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.066502 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 06:38:21.116913 tst ping_idle_ping.py: using LAC 19622 06:38:21.245572 tst ping_idle_ping.py: using RAC 242 06:38:21.373794 tst ping_idle_ping.py: using CellId 19622 06:38:21.501664 tst ping_idle_ping.py: using BVCI 19623 06:38:21.623770 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.635897 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.647975 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.660514 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.672876 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.685373 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.699111 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 06:38:21.711157 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 06:38:21.832524 tst ping_idle_ping.py:24: start network... 06:38:22.054518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:22.568320 run create_hlr_db(pid=3315): Launched 06:38:22.735554 bus /gobi_6: Setting Powered False 06:38:23.799089 run create_hlr_db(pid=3315): Terminated: ok {rc=0} 06:38:24.260075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3317): Launched 06:38:24.602045 run osmo-hlr_10.42.42.2(pid=3318): Launched 06:38:24.843894 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:25.509884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3320): Launched 06:38:25.829961 run osmo-stp_10.42.42.5(pid=3321): Launched 06:38:25.941833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:26.447906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3323): Launched 06:38:26.560832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:26.809509 run patchelf(pid=3324): Launched 06:38:26.973975 run osmo-stp_10.42.42.5(pid=3321): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3321)] 06:38:27.099321 run osmo-stp_10.42.42.5(pid=3321): stdout: | (launched: 2022-12-09_06:38:25.775637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:27.226233 run osmo-stp_10.42.42.5(pid=3321): stderr: | 20221209063825944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063825944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063825944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063825945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063825945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063825945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063825945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:27.353525 run osmo-stp_10.42.42.5(pid=3321): stdout: | (launched: 2022-12-09_06:38:25.775637) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:27.474441 run osmo-stp_10.42.42.5(pid=3321): stderr: | 20221209063825944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063825944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063825944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063825945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063825945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063825945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063825945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:27.617686 run patchelf(pid=3324): Terminating (SIGINT) 06:38:27.784333 run patchelf(pid=3324): Terminated: ok {rc=0} 06:38:27.903902 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3321): Process ended prematurely: osmo-stp_10.42.42.5(pid=3321) [trial-2355↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3321)] [trial-2355↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 06:38:27.912701 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 06:38:27.939970 run osmo-hlr_10.42.42.2(pid=3318): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3318)] 06:38:27.987862 run osmo-hlr_10.42.42.2(pid=3318): stdout: | (launched: 2022-12-09_06:38:24.538703) 06:38:28.037605 run osmo-hlr_10.42.42.2(pid=3318): stderr: | 20221209063824849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063824849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063824849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063824849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063824849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063824849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063824863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063824880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063824880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063824880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:28.087852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3317): Terminating (SIGTERM) 06:38:28.128189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3320): Terminating (SIGTERM) 06:38:28.168288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3323): Terminating (SIGTERM) 06:38:28.208674 --- ParallelTerminationStrategy: PID 3317 died... 06:38:28.227878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3317): Terminated: ok {rc=0} 06:38:28.272571 --- ParallelTerminationStrategy: PID 3320 died... 06:38:28.291586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3320): Terminated: ok {rc=0} 06:38:28.336252 --- ParallelTerminationStrategy: PID 3323 died... 06:38:28.354992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3323): Terminated: ok {rc=0} 06:38:28.439290 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 06:38:29.744926 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:38:29.752159 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 06:38:29.787072 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 06:38:29.826425 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 06:38:29.914817 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 06:38:29.948186 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 06:38:29.987880 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 06:38:30.588278 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 06:38:30.640710 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:30.652053 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:30.702635 tst cs_paging_gprs_active.py: using LAC 19623 06:38:30.829066 tst cs_paging_gprs_active.py: using RAC 243 06:38:30.975429 tst cs_paging_gprs_active.py: using CellId 19623 06:38:31.104446 tst cs_paging_gprs_active.py: using BVCI 19624 06:38:31.224050 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.235987 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.247730 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.259857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.271870 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.283979 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.296206 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.308291 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:31.320464 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:31.453668 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:31.579182 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:38:31.816730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:32.132151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Launched 06:38:32.413467 run iperf3-srv_10.42.42.10(pid=3329): Launched 06:38:32.528363 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:38:32.728767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:33.031002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Launched 06:38:33.292151 run iperf3-srv_10.42.42.10(pid=3331): Launched 06:38:33.404605 tst cs_paging_gprs_active.py:38: start network... 06:38:33.604555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:34.069624 run create_hlr_db(pid=3332): Launched 06:38:34.190871 bus /gobi_6: Setting Powered False 06:38:35.251278 run create_hlr_db(pid=3332): Terminated: ok {rc=0} 06:38:35.691811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Launched 06:38:36.014024 run osmo-hlr_10.42.42.2(pid=3335): Launched 06:38:36.136860 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:36.658211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Launched 06:38:36.959716 run osmo-stp_10.42.42.5(pid=3338): Launched 06:38:37.074447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:37.604033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3340): Launched 06:38:37.719587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:37.973473 run patchelf(pid=3341): Launched 06:38:38.141252 run osmo-stp_10.42.42.5(pid=3338): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] 06:38:38.269044 run osmo-stp_10.42.42.5(pid=3338): stdout: | (launched: 2022-12-09_06:38:36.904245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:38.398658 run osmo-stp_10.42.42.5(pid=3338): stderr: | 20221209063837075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063837075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063837076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063837076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063837077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063837077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063837077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:38.528264 run osmo-stp_10.42.42.5(pid=3338): stdout: | (launched: 2022-12-09_06:38:36.904245) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:38.652276 run osmo-stp_10.42.42.5(pid=3338): stderr: | 20221209063837075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063837075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063837076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063837076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063837077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063837077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063837077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:38.798599 run patchelf(pid=3341): Terminating (SIGINT) 06:38:38.968614 run patchelf(pid=3341): Terminated: ok {rc=0} 06:38:39.090896 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3338): Process ended prematurely: osmo-stp_10.42.42.5(pid=3338) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 06:38:39.100214 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 06:38:39.128119 run osmo-hlr_10.42.42.2(pid=3335): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3335)] 06:38:39.176159 run osmo-hlr_10.42.42.2(pid=3335): stdout: | (launched: 2022-12-09_06:38:35.955546) 06:38:39.226002 run osmo-hlr_10.42.42.2(pid=3335): stderr: | 20221209063836152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063836152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063836152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063836152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063836152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063836152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063836164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063836172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063836173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063836173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:39.276155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminating (SIGTERM) 06:38:39.316492 run iperf3-srv_10.42.42.10(pid=3329): Terminating (SIGTERM) 06:38:39.356626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminating (SIGTERM) 06:38:39.396892 run iperf3-srv_10.42.42.10(pid=3331): Terminating (SIGTERM) 06:38:39.436933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Terminating (SIGTERM) 06:38:39.477120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Terminating (SIGTERM) 06:38:39.517148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3340): Terminating (SIGTERM) 06:38:39.557574 --- ParallelTerminationStrategy: PID 3328 died... 06:38:39.576473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3328): Terminated: ok {rc=0} 06:38:39.621342 --- ParallelTerminationStrategy: PID 3329 died... 06:38:39.640115 run iperf3-srv_10.42.42.10(pid=3329): Terminated {rc=256} 06:38:39.684701 --- ParallelTerminationStrategy: PID 3330 died... 06:38:39.703665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3330): Terminated: ok {rc=0} 06:38:39.748194 --- ParallelTerminationStrategy: PID 3331 died... 06:38:39.766791 run iperf3-srv_10.42.42.10(pid=3331): Terminated {rc=256} 06:38:39.811884 --- ParallelTerminationStrategy: PID 3334 died... 06:38:39.830572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3334): Terminated: ok {rc=0} 06:38:39.874478 --- ParallelTerminationStrategy: PID 3337 died... 06:38:39.893112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3337): Terminated: ok {rc=0} 06:38:39.937453 --- ParallelTerminationStrategy: PID 3340 died... 06:38:39.956038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3340): Terminated: ok {rc=0} 06:38:40.040234 bus /gobi_0: Setting Powered False 06:38:41.135799 bus /gobi_0: Setting Powered False 06:38:42.251528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 06:38:43.394304 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:43.405754 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:43.457846 tst iperf3.py: using LAC 19624 06:38:43.585706 tst iperf3.py: using RAC 244 06:38:43.715793 tst iperf3.py: using CellId 19624 06:38:43.841333 tst iperf3.py: using BVCI 19625 06:38:43.958772 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:43.970328 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:43.981678 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:43.993218 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:44.004531 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:44.015894 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:44.027519 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:44.038733 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:44.050191 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:44.165312 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:38:44.366889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:44.668922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Launched 06:38:44.931228 run iperf3-srv_10.42.42.10(pid=3344): Launched 06:38:45.045711 tst iperf3.py:8: start network... 06:38:45.246844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:45.713453 run create_hlr_db(pid=3345): Launched 06:38:45.827790 bus /gobi_6: Setting Powered False 06:38:46.915888 run create_hlr_db(pid=3345): Terminated: ok {rc=0} 06:38:47.418808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Launched 06:38:47.720094 run osmo-hlr_10.42.42.2(pid=3348): Launched 06:38:47.834815 run osmo-stp_10.42.42.5: Starting osmo-stp 06:38:48.363108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Launched 06:38:48.662688 run osmo-stp_10.42.42.5(pid=3351): Launched 06:38:48.776082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:38:49.293779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Launched 06:38:49.409106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:38:49.664235 run patchelf(pid=3354): Launched 06:38:49.832157 run osmo-stp_10.42.42.5(pid=3351): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3351)] 06:38:49.959521 run osmo-stp_10.42.42.5(pid=3351): stdout: | (launched: 2022-12-09_06:38:48.607763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:50.088406 run osmo-stp_10.42.42.5(pid=3351): stderr: | 20221209063848775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063848775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063848775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063848776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063848778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063848778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063848778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:50.217836 run osmo-stp_10.42.42.5(pid=3351): stdout: | (launched: 2022-12-09_06:38:48.607763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:38:50.341653 run osmo-stp_10.42.42.5(pid=3351): stderr: | 20221209063848775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063848775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063848775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063848776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063848778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063848778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063848778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:38:50.488612 run patchelf(pid=3354): Terminating (SIGINT) 06:38:50.657113 run patchelf(pid=3354): Terminated: ok {rc=0} 06:38:50.778426 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3351): Process ended prematurely: osmo-stp_10.42.42.5(pid=3351) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3351)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 06:38:50.787781 tst iperf3.py:8: Test FAILED (7.4 sec) 06:38:50.815358 run osmo-hlr_10.42.42.2(pid=3348): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3348)] 06:38:50.863242 run osmo-hlr_10.42.42.2(pid=3348): stdout: | (launched: 2022-12-09_06:38:47.665270) 06:38:50.912837 run osmo-hlr_10.42.42.2(pid=3348): stderr: | 20221209063847840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063847840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063847840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063847840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063847840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063847840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063847853 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063847861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063847861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063847861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:38:50.962627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Terminating (SIGTERM) 06:38:51.003104 run iperf3-srv_10.42.42.10(pid=3344): Terminating (SIGTERM) 06:38:51.043416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Terminating (SIGTERM) 06:38:51.083629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Terminating (SIGTERM) 06:38:51.123887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Terminating (SIGTERM) 06:38:51.164472 --- ParallelTerminationStrategy: PID 3343 died... 06:38:51.183710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Terminated: ok {rc=0} 06:38:51.228464 --- ParallelTerminationStrategy: PID 3344 died... 06:38:51.247312 run iperf3-srv_10.42.42.10(pid=3344): Terminated {rc=256} 06:38:51.291689 --- ParallelTerminationStrategy: PID 3347 died... 06:38:51.310404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Terminated: ok {rc=0} 06:38:51.354995 --- ParallelTerminationStrategy: PID 3350 died... 06:38:51.373757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Terminated: ok {rc=0} 06:38:51.418259 --- ParallelTerminationStrategy: PID 3353 died... 06:38:51.437126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Terminated: ok {rc=0} 06:38:51.520921 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 06:38:52.670554 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:52.682718 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:38:52.733088 tst iperf3m4.py: using LAC 19625 06:38:52.859511 tst iperf3m4.py: using RAC 245 06:38:52.986176 tst iperf3m4.py: using CellId 19625 06:38:53.114777 tst iperf3m4.py: using BVCI 19626 06:38:53.234304 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.245737 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.256904 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.268284 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.279626 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.290848 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.302421 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.313713 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:38:53.325229 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:53.442349 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:53.563365 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:53.678214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:38:53.797267 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:38:53.998578 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:54.300196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Launched 06:38:54.562443 run iperf3-srv_10.42.42.10(pid=3356): Launched 06:38:54.675139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:38:54.874965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:55.176503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3357): Launched 06:38:55.437847 run iperf3-srv_10.42.42.10(pid=3358): Launched 06:38:55.550335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:38:55.750752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:56.051400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3359): Launched 06:38:56.313311 run iperf3-srv_10.42.42.10(pid=3360): Launched 06:38:56.425831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:38:56.625938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:38:56.926729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3361): Launched 06:38:57.189160 run iperf3-srv_10.42.42.10(pid=3362): Launched 06:38:57.301482 tst iperf3m4.py:8: start network... 06:38:57.501119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:38:57.964481 run create_hlr_db(pid=3363): Launched 06:38:58.079874 bus /gobi_6: Setting Powered False 06:38:59.139914 run create_hlr_db(pid=3363): Terminated: ok {rc=0} 06:38:59.578617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3366): Launched 06:38:59.899138 run osmo-hlr_10.42.42.2(pid=3367): Launched 06:39:00.021735 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:00.581275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3369): Launched 06:39:00.933778 run osmo-stp_10.42.42.5(pid=3370): Launched 06:39:01.185850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:01.986873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3372): Launched 06:39:02.136183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:02.417202 run patchelf(pid=3373): Launched 06:39:02.595169 run osmo-stp_10.42.42.5(pid=3370): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3370)] 06:39:02.731513 run osmo-stp_10.42.42.5(pid=3370): stdout: | (launched: 2022-12-09_06:39:00.853507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:02.869231 run osmo-stp_10.42.42.5(pid=3370): stderr: | 20221209063901235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063901236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063901236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063901237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063901237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063901238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063901238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:03.007066 run osmo-stp_10.42.42.5(pid=3370): stdout: | (launched: 2022-12-09_06:39:00.853507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:03.140491 run osmo-stp_10.42.42.5(pid=3370): stderr: | 20221209063901235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063901236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063901236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063901237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063901237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063901238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063901238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:03.297437 run patchelf(pid=3373): Terminating (SIGINT) 06:39:03.477776 run patchelf(pid=3373): Terminated: ok {rc=0} 06:39:03.607502 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3370): Process ended prematurely: osmo-stp_10.42.42.5(pid=3370) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3370)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 06:39:03.617734 tst iperf3m4.py:8: Test FAILED (11.0 sec) 06:39:03.646613 run osmo-hlr_10.42.42.2(pid=3367): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3367)] 06:39:03.696408 run osmo-hlr_10.42.42.2(pid=3367): stdout: | (launched: 2022-12-09_06:38:59.840480) 06:39:03.748106 run osmo-hlr_10.42.42.2(pid=3367): stderr: | 20221209063900036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063900036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063900036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063900036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063900037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063900037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063900049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063900057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063900058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063900058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:03.800244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Terminating (SIGTERM) 06:39:03.842295 run iperf3-srv_10.42.42.10(pid=3356): Terminating (SIGTERM) 06:39:03.884250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3357): Terminating (SIGTERM) 06:39:03.926393 run iperf3-srv_10.42.42.10(pid=3358): Terminating (SIGTERM) 06:39:03.968285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3359): Terminating (SIGTERM) 06:39:04.010225 run iperf3-srv_10.42.42.10(pid=3360): Terminating (SIGTERM) 06:39:04.052175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3361): Terminating (SIGTERM) 06:39:04.094310 run iperf3-srv_10.42.42.10(pid=3362): Terminating (SIGTERM) 06:39:04.136502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3366): Terminating (SIGTERM) 06:39:04.178724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3369): Terminating (SIGTERM) 06:39:04.220620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3372): Terminating (SIGTERM) 06:39:04.263069 --- ParallelTerminationStrategy: PID 3355 died... 06:39:04.283196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Terminated: ok {rc=0} 06:39:04.329749 --- ParallelTerminationStrategy: PID 3356 died... 06:39:04.349438 run iperf3-srv_10.42.42.10(pid=3356): Terminated {rc=256} 06:39:04.395458 --- ParallelTerminationStrategy: PID 3357 died... 06:39:04.415182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3357): Terminated: ok {rc=0} 06:39:04.461451 --- ParallelTerminationStrategy: PID 3358 died... 06:39:04.481076 run iperf3-srv_10.42.42.10(pid=3358): Terminated {rc=256} 06:39:04.527171 --- ParallelTerminationStrategy: PID 3359 died... 06:39:04.546907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3359): Terminated: ok {rc=0} 06:39:04.593232 --- ParallelTerminationStrategy: PID 3360 died... 06:39:04.612786 run iperf3-srv_10.42.42.10(pid=3360): Terminated {rc=256} 06:39:04.659044 --- ParallelTerminationStrategy: PID 3361 died... 06:39:04.678831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3361): Terminated: ok {rc=0} 06:39:04.725260 --- ParallelTerminationStrategy: PID 3362 died... 06:39:04.744629 run iperf3-srv_10.42.42.10(pid=3362): Terminated {rc=256} 06:39:04.791006 --- ParallelTerminationStrategy: PID 3366 died... 06:39:04.810677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3366): Terminated: ok {rc=0} 06:39:04.857112 --- ParallelTerminationStrategy: PID 3369 died... 06:39:04.876770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3369): Terminated: ok {rc=0} 06:39:04.923182 --- ParallelTerminationStrategy: PID 3372 died... 06:39:04.943040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3372): Terminated: ok {rc=0} 06:39:05.030937 bus /gobi_4: Setting Powered False 06:39:06.130654 bus /gobi_4: Setting Powered False 06:39:07.245665 bus /gobi_1: Setting Powered False 06:39:08.344121 bus /gobi_1: Setting Powered False 06:39:09.460523 bus /gobi_0: Setting Powered False 06:39:10.558654 bus /gobi_0: Setting Powered False 06:39:11.678383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 06:39:12.781707 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:12.792904 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:39:12.843588 tst ping.py: using LAC 19626 06:39:12.961483 tst ping.py: using RAC 246 06:39:13.085534 tst ping.py: using CellId 19626 06:39:13.204772 tst ping.py: using BVCI 19627 06:39:13.321155 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.332756 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.344228 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.355914 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.367444 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.379089 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.391023 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:13.402647 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:39:13.518988 tst ping.py:19: start network... 06:39:13.715507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:14.171801 run create_hlr_db(pid=3374): Launched 06:39:14.285054 bus /gobi_6: Setting Powered False 06:39:15.345276 run create_hlr_db(pid=3374): Terminated: ok {rc=0} 06:39:15.778830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3376): Launched 06:39:16.126401 run osmo-hlr_10.42.42.2(pid=3377): Launched 06:39:16.367441 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:17.021927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3379): Launched 06:39:17.342983 run osmo-stp_10.42.42.5(pid=3380): Launched 06:39:17.471932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:18.018338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3382): Launched 06:39:18.141399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:18.410705 run patchelf(pid=3383): Launched 06:39:18.587978 run osmo-stp_10.42.42.5(pid=3380): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3380)] 06:39:18.723452 run osmo-stp_10.42.42.5(pid=3380): stdout: | (launched: 2022-12-09_06:39:17.280728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:18.859489 run osmo-stp_10.42.42.5(pid=3380): stderr: | 20221209063917480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063917480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063917481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063917481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063917482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063917482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063917482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:18.995935 run osmo-stp_10.42.42.5(pid=3380): stdout: | (launched: 2022-12-09_06:39:17.280728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:19.127013 run osmo-stp_10.42.42.5(pid=3380): stderr: | 20221209063917480 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063917480 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063917481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063917481 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063917482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063917482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063917482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:19.281652 run patchelf(pid=3383): Terminating (SIGINT) 06:39:19.460142 run patchelf(pid=3383): Terminated: ok {rc=0} 06:39:19.588695 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3380): Process ended prematurely: osmo-stp_10.42.42.5(pid=3380) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3380)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 06:39:19.598353 tst ping.py:22: Test FAILED (6.8 sec) 06:39:19.626796 run osmo-hlr_10.42.42.2(pid=3377): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3377)] 06:39:19.677070 run osmo-hlr_10.42.42.2(pid=3377): stdout: | (launched: 2022-12-09_06:39:16.056816) 06:39:19.729359 run osmo-hlr_10.42.42.2(pid=3377): stderr: | 20221209063916361 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063916361 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063916361 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063916361 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063916361 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063916361 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063916381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063916389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063916389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063916389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:19.781962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3376): Terminating (SIGTERM) 06:39:19.824355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3379): Terminating (SIGTERM) 06:39:19.866832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3382): Terminating (SIGTERM) 06:39:19.909684 --- ParallelTerminationStrategy: PID 3376 died... 06:39:19.929643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3376): Terminated: ok {rc=0} 06:39:19.976528 --- ParallelTerminationStrategy: PID 3379 died... 06:39:19.996455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3379): Terminated: ok {rc=0} 06:39:20.043292 --- ParallelTerminationStrategy: PID 3382 died... 06:39:20.063110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3382): Terminated: ok {rc=0} 06:39:20.151683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 06:39:21.239718 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.252084 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 06:39:21.303579 tst ping_idle_ping.py: using LAC 19627 06:39:21.429397 tst ping_idle_ping.py: using RAC 247 06:39:21.556441 tst ping_idle_ping.py: using CellId 19627 06:39:21.672604 tst ping_idle_ping.py: using BVCI 19628 06:39:21.779867 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.790849 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.801779 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.813335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.824696 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.836172 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.848008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 06:39:21.859606 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 06:39:21.977404 tst ping_idle_ping.py:24: start network... 06:39:22.192596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:22.686502 run create_hlr_db(pid=3384): Launched 06:39:22.815877 bus /gobi_6: Setting Powered False 06:39:23.879947 run create_hlr_db(pid=3384): Terminated: ok {rc=0} 06:39:24.305694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Launched 06:39:24.602847 run osmo-hlr_10.42.42.2(pid=3387): Launched 06:39:24.715123 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:25.239539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Launched 06:39:25.536694 run osmo-stp_10.42.42.5(pid=3390): Launched 06:39:25.649556 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:26.162828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Launched 06:39:26.276876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:26.527428 run patchelf(pid=3393): Launched 06:39:26.692919 run osmo-stp_10.42.42.5(pid=3390): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] 06:39:26.818734 run osmo-stp_10.42.42.5(pid=3390): stdout: | (launched: 2022-12-09_06:39:25.482422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:26.946577 run osmo-stp_10.42.42.5(pid=3390): stderr: | 20221209063925652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063925652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063925652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063925653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063925653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063925653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063925653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:27.074236 run osmo-stp_10.42.42.5(pid=3390): stdout: | (launched: 2022-12-09_06:39:25.482422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:27.195770 run osmo-stp_10.42.42.5(pid=3390): stderr: | 20221209063925652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063925652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063925652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063925653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063925653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063925653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063925653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:27.339747 run patchelf(pid=3393): Terminating (SIGINT) 06:39:27.506665 run patchelf(pid=3393): Terminated: ok {rc=0} 06:39:27.626697 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3390): Process ended prematurely: osmo-stp_10.42.42.5(pid=3390) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 06:39:27.635516 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:39:27.662862 run osmo-hlr_10.42.42.2(pid=3387): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3387)] 06:39:27.711626 run osmo-hlr_10.42.42.2(pid=3387): stdout: | (launched: 2022-12-09_06:39:24.548196) 06:39:27.761700 run osmo-hlr_10.42.42.2(pid=3387): stderr: | 20221209063924725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063924725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063924725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063924725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063924725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063924725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063924737 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063924745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063924746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063924746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:27.812256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Terminating (SIGTERM) 06:39:27.853168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Terminating (SIGTERM) 06:39:27.893640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Terminating (SIGTERM) 06:39:27.934464 --- ParallelTerminationStrategy: PID 3386 died... 06:39:27.953798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3386): Terminated: ok {rc=0} 06:39:27.998973 --- ParallelTerminationStrategy: PID 3389 died... 06:39:28.017895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3389): Terminated: ok {rc=0} 06:39:28.062828 --- ParallelTerminationStrategy: PID 3392 died... 06:39:28.081663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3392): Terminated: ok {rc=0} 06:39:28.169216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 06:39:29.478933 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:39:29.486608 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 06:39:29.519927 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 06:39:29.559221 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 06:39:29.647469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 06:39:29.680737 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 06:39:29.720328 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 06:39:30.316765 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 06:39:30.368698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:30.380217 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:30.448326 tst cs_paging_gprs_active.py: using LAC 19628 06:39:30.577209 tst cs_paging_gprs_active.py: using RAC 248 06:39:30.703475 tst cs_paging_gprs_active.py: using CellId 19628 06:39:30.832283 tst cs_paging_gprs_active.py: using BVCI 19629 06:39:30.973109 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:30.985011 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:30.996710 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.010674 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.025726 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.037623 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.050578 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.064495 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:31.077677 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:31.200854 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:31.346624 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:39:31.583134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:31.918408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3398): Launched 06:39:32.210185 run iperf3-srv_10.42.42.10(pid=3399): Launched 06:39:32.331505 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:39:32.548835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:32.872701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3400): Launched 06:39:33.153472 run iperf3-srv_10.42.42.10(pid=3401): Launched 06:39:33.274524 tst cs_paging_gprs_active.py:38: start network... 06:39:33.491962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:33.992247 run create_hlr_db(pid=3402): Launched 06:39:34.123942 bus /gobi_6: Setting Powered False 06:39:35.188773 run create_hlr_db(pid=3402): Terminated: ok {rc=0} 06:39:35.617930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3404): Launched 06:39:35.920096 run osmo-hlr_10.42.42.2(pid=3405): Launched 06:39:36.034732 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:36.554566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3407): Launched 06:39:36.854734 run osmo-stp_10.42.42.5(pid=3408): Launched 06:39:36.968670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:37.489236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3410): Launched 06:39:37.605098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:37.859242 run patchelf(pid=3411): Launched 06:39:38.025998 run osmo-stp_10.42.42.5(pid=3408): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3408)] 06:39:38.153951 run osmo-stp_10.42.42.5(pid=3408): stdout: | (launched: 2022-12-09_06:39:36.799748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:38.283148 run osmo-stp_10.42.42.5(pid=3408): stderr: | 20221209063936967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063936967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063936967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063936968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063936970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063936970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063936970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:38.412130 run osmo-stp_10.42.42.5(pid=3408): stdout: | (launched: 2022-12-09_06:39:36.799748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:38.535646 run osmo-stp_10.42.42.5(pid=3408): stderr: | 20221209063936967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063936967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063936967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063936968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063936970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063936970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063936970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:38.682045 run patchelf(pid=3411): Terminating (SIGINT) 06:39:38.851209 run patchelf(pid=3411): Terminated: ok {rc=0} 06:39:38.972830 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3408): Process ended prematurely: osmo-stp_10.42.42.5(pid=3408) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3408)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 06:39:38.982377 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 06:39:39.009623 run osmo-hlr_10.42.42.2(pid=3405): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3405)] 06:39:39.057637 run osmo-hlr_10.42.42.2(pid=3405): stdout: | (launched: 2022-12-09_06:39:35.864666) 06:39:39.107219 run osmo-hlr_10.42.42.2(pid=3405): stderr: | 20221209063936042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063936042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063936042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063936042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063936042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063936042 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063936054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063936065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063936065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063936066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:39.157457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3398): Terminating (SIGTERM) 06:39:39.197332 run iperf3-srv_10.42.42.10(pid=3399): Terminating (SIGTERM) 06:39:39.237229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3400): Terminating (SIGTERM) 06:39:39.277744 run iperf3-srv_10.42.42.10(pid=3401): Terminating (SIGTERM) 06:39:39.317591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3404): Terminating (SIGTERM) 06:39:39.357531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3407): Terminating (SIGTERM) 06:39:39.397650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3410): Terminating (SIGTERM) 06:39:39.437574 --- ParallelTerminationStrategy: PID 3398 died... 06:39:39.457232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3398): Terminated: ok {rc=0} 06:39:39.501880 --- ParallelTerminationStrategy: PID 3399 died... 06:39:39.520201 run iperf3-srv_10.42.42.10(pid=3399): Terminated {rc=256} 06:39:39.564740 --- ParallelTerminationStrategy: PID 3400 died... 06:39:39.583404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3400): Terminated: ok {rc=0} 06:39:39.627536 --- ParallelTerminationStrategy: PID 3401 died... 06:39:39.646156 run iperf3-srv_10.42.42.10(pid=3401): Terminated {rc=256} 06:39:39.690914 --- ParallelTerminationStrategy: PID 3404 died... 06:39:39.709543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3404): Terminated: ok {rc=0} 06:39:39.753979 --- ParallelTerminationStrategy: PID 3407 died... 06:39:39.772797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3407): Terminated: ok {rc=0} 06:39:39.817825 --- ParallelTerminationStrategy: PID 3410 died... 06:39:39.836564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3410): Terminated: ok {rc=0} 06:39:39.920773 bus /gobi_0: Setting Powered False 06:39:41.018135 bus /gobi_0: Setting Powered False 06:39:42.134085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 06:39:43.281502 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.293420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:43.364385 tst iperf3.py: using LAC 19629 06:39:43.492360 tst iperf3.py: using RAC 249 06:39:43.623207 tst iperf3.py: using CellId 19629 06:39:43.741196 tst iperf3.py: using BVCI 19630 06:39:43.849799 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.861075 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.871901 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.883165 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.894418 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.905719 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.917009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.928241 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:43.939430 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:44.057473 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:44.274820 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:44.598305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3412): Launched 06:39:44.878466 run iperf3-srv_10.42.42.10(pid=3413): Launched 06:39:44.998823 tst iperf3.py:8: start network... 06:39:45.216414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:45.717535 run create_hlr_db(pid=3414): Launched 06:39:45.864776 bus /gobi_6: Setting Powered False 06:39:46.925758 run create_hlr_db(pid=3414): Terminated: ok {rc=0} 06:39:47.413666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3416): Launched 06:39:47.714960 run osmo-hlr_10.42.42.2(pid=3417): Launched 06:39:47.829257 run osmo-stp_10.42.42.5: Starting osmo-stp 06:39:48.360526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3419): Launched 06:39:48.660146 run osmo-stp_10.42.42.5(pid=3420): Launched 06:39:48.774784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:39:49.291712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3422): Launched 06:39:49.407180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:39:49.661556 run patchelf(pid=3423): Launched 06:39:49.828553 run osmo-stp_10.42.42.5(pid=3420): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3420)] 06:39:49.956070 run osmo-stp_10.42.42.5(pid=3420): stdout: | (launched: 2022-12-09_06:39:48.605269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:50.084811 run osmo-stp_10.42.42.5(pid=3420): stderr: | 20221209063948775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063948775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063948775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063948776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063948776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063948776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063948776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:50.213888 run osmo-stp_10.42.42.5(pid=3420): stdout: | (launched: 2022-12-09_06:39:48.605269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:39:50.337919 run osmo-stp_10.42.42.5(pid=3420): stderr: | 20221209063948775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209063948775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209063948775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209063948776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209063948776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209063948776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209063948776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:39:50.485220 run patchelf(pid=3423): Terminating (SIGINT) 06:39:50.655004 run patchelf(pid=3423): Terminated: ok {rc=0} 06:39:50.776789 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3420): Process ended prematurely: osmo-stp_10.42.42.5(pid=3420) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3420)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 06:39:50.786381 tst iperf3.py:8: Test FAILED (7.5 sec) 06:39:50.813792 run osmo-hlr_10.42.42.2(pid=3417): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3417)] 06:39:50.861760 run osmo-hlr_10.42.42.2(pid=3417): stdout: | (launched: 2022-12-09_06:39:47.659673) 06:39:50.911153 run osmo-hlr_10.42.42.2(pid=3417): stderr: | 20221209063947837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063947837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063947838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063947838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063947838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063947838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063947850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209063947861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209063947861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209063947861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:39:50.961173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3412): Terminating (SIGTERM) 06:39:51.001478 run iperf3-srv_10.42.42.10(pid=3413): Terminating (SIGTERM) 06:39:51.041736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3416): Terminating (SIGTERM) 06:39:51.082170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3419): Terminating (SIGTERM) 06:39:51.122530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3422): Terminating (SIGTERM) 06:39:51.163101 --- ParallelTerminationStrategy: PID 3412 died... 06:39:51.182256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3412): Terminated: ok {rc=0} 06:39:51.227074 --- ParallelTerminationStrategy: PID 3413 died... 06:39:51.245856 run iperf3-srv_10.42.42.10(pid=3413): Terminated {rc=256} 06:39:51.290297 --- ParallelTerminationStrategy: PID 3416 died... 06:39:51.308906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3416): Terminated: ok {rc=0} 06:39:51.353346 --- ParallelTerminationStrategy: PID 3419 died... 06:39:51.371657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3419): Terminated: ok {rc=0} 06:39:51.416064 --- ParallelTerminationStrategy: PID 3422 died... 06:39:51.434797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3422): Terminated: ok {rc=0} 06:39:51.519302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 06:39:52.661886 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:52.673916 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:39:52.740925 tst iperf3m4.py: using LAC 19630 06:39:52.858507 tst iperf3m4.py: using RAC 250 06:39:52.978286 tst iperf3m4.py: using CellId 19630 06:39:53.100861 tst iperf3m4.py: using BVCI 19631 06:39:53.212145 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.223262 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.233978 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.245229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.256119 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.267249 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.278351 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.289498 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:39:53.300581 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:53.419312 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:53.545896 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:53.667584 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:39:53.784591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:39:53.986440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:54.288775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3424): Launched 06:39:54.551355 run iperf3-srv_10.42.42.10(pid=3425): Launched 06:39:54.665210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:39:54.866400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:55.168217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3426): Launched 06:39:55.431191 run iperf3-srv_10.42.42.10(pid=3427): Launched 06:39:55.545274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:39:55.746931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:56.049529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3428): Launched 06:39:56.312768 run iperf3-srv_10.42.42.10(pid=3429): Launched 06:39:56.425707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:39:56.626852 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:39:56.929495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3430): Launched 06:39:57.193051 run iperf3-srv_10.42.42.10(pid=3431): Launched 06:39:57.306060 tst iperf3m4.py:8: start network... 06:39:57.507807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:39:57.974465 run create_hlr_db(pid=3432): Launched 06:39:58.088130 bus /gobi_6: Setting Powered False 06:39:59.149056 run create_hlr_db(pid=3432): Terminated: ok {rc=0} 06:39:59.567991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Launched 06:39:59.868117 run osmo-hlr_10.42.42.2(pid=3435): Launched 06:39:59.982319 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:00.497316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Launched 06:40:00.797716 run osmo-stp_10.42.42.5(pid=3438): Launched 06:40:00.947934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:01.672430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3443): Launched 06:40:01.804530 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:02.101373 run patchelf(pid=3444): Launched 06:40:02.299779 run osmo-stp_10.42.42.5(pid=3438): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] 06:40:02.427665 run osmo-stp_10.42.42.5(pid=3438): stdout: | (launched: 2022-12-09_06:40:00.742277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:02.556775 run osmo-stp_10.42.42.5(pid=3438): stderr: | 20221209064001006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064001006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064001006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064001007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064001007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064001007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064001007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:02.686089 run osmo-stp_10.42.42.5(pid=3438): stdout: | (launched: 2022-12-09_06:40:00.742277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:02.810050 run osmo-stp_10.42.42.5(pid=3438): stderr: | 20221209064001006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064001006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064001006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064001007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064001007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064001007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064001007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:02.957547 run patchelf(pid=3444): Terminating (SIGINT) 06:40:03.127130 run patchelf(pid=3444): Terminated: ok {rc=0} 06:40:03.249369 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3438): Process ended prematurely: osmo-stp_10.42.42.5(pid=3438) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 06:40:03.259171 tst iperf3m4.py:8: Test FAILED (10.6 sec) 06:40:03.287474 run osmo-hlr_10.42.42.2(pid=3435): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3435)] 06:40:03.335621 run osmo-hlr_10.42.42.2(pid=3435): stdout: | (launched: 2022-12-09_06:39:59.812795) 06:40:03.385561 run osmo-hlr_10.42.42.2(pid=3435): stderr: | 20221209063959987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209063959987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209063959987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209063959987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209063959987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209063959987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209063959999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064000008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064000008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064000008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:03.435775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3424): Terminating (SIGTERM) 06:40:03.476582 run iperf3-srv_10.42.42.10(pid=3425): Terminating (SIGTERM) 06:40:03.517356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3426): Terminating (SIGTERM) 06:40:03.558093 run iperf3-srv_10.42.42.10(pid=3427): Terminating (SIGTERM) 06:40:03.598723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3428): Terminating (SIGTERM) 06:40:03.639160 run iperf3-srv_10.42.42.10(pid=3429): Terminating (SIGTERM) 06:40:03.679303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3430): Terminating (SIGTERM) 06:40:03.719625 run iperf3-srv_10.42.42.10(pid=3431): Terminating (SIGTERM) 06:40:03.759782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Terminating (SIGTERM) 06:40:03.799623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Terminating (SIGTERM) 06:40:03.839714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3443): Terminating (SIGTERM) 06:40:03.880168 --- ParallelTerminationStrategy: PID 3424 died... 06:40:03.898884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3424): Terminated: ok {rc=0} 06:40:03.944150 --- ParallelTerminationStrategy: PID 3425 died... 06:40:03.962957 run iperf3-srv_10.42.42.10(pid=3425): Terminated {rc=256} 06:40:04.007860 --- ParallelTerminationStrategy: PID 3426 died... 06:40:04.026974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3426): Terminated: ok {rc=0} 06:40:04.071778 --- ParallelTerminationStrategy: PID 3427 died... 06:40:04.090794 run iperf3-srv_10.42.42.10(pid=3427): Terminated {rc=256} 06:40:04.136025 --- ParallelTerminationStrategy: PID 3428 died... 06:40:04.155001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3428): Terminated: ok {rc=0} 06:40:04.200056 --- ParallelTerminationStrategy: PID 3429 died... 06:40:04.219117 run iperf3-srv_10.42.42.10(pid=3429): Terminated {rc=256} 06:40:04.264171 --- ParallelTerminationStrategy: PID 3430 died... 06:40:04.283335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3430): Terminated: ok {rc=0} 06:40:04.328575 --- ParallelTerminationStrategy: PID 3431 died... 06:40:04.347523 run iperf3-srv_10.42.42.10(pid=3431): Terminated {rc=256} 06:40:04.392636 --- ParallelTerminationStrategy: PID 3434 died... 06:40:04.411743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3434): Terminated: ok {rc=0} 06:40:04.456865 --- ParallelTerminationStrategy: PID 3437 died... 06:40:04.476246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3437): Terminated: ok {rc=0} 06:40:04.521677 --- ParallelTerminationStrategy: PID 3443 died... 06:40:04.540696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3443): Terminated: ok {rc=0} 06:40:04.627624 bus /gobi_4: Setting Powered False 06:40:05.727822 bus /gobi_4: Setting Powered False 06:40:06.843704 bus /gobi_1: Setting Powered False 06:40:07.943068 bus /gobi_1: Setting Powered False 06:40:09.058501 bus /gobi_0: Setting Powered False 06:40:10.156486 bus /gobi_0: Setting Powered False 06:40:11.273682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 06:40:12.375695 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.387310 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:40:12.456746 tst ping.py: using LAC 19631 06:40:12.571421 tst ping.py: using RAC 251 06:40:12.687735 tst ping.py: using CellId 19631 06:40:12.802227 tst ping.py: using BVCI 19632 06:40:12.908314 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.919407 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.930144 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.941172 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.952073 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.963079 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.974289 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:12.985202 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:40:13.098801 tst ping.py:19: start network... 06:40:13.295414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:13.750491 run create_hlr_db(pid=3445): Launched 06:40:13.862133 bus /gobi_6: Setting Powered False 06:40:14.921186 run create_hlr_db(pid=3445): Terminated: ok {rc=0} 06:40:15.353740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3447): Launched 06:40:15.669398 run osmo-hlr_10.42.42.2(pid=3448): Launched 06:40:15.789851 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:16.510674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Launched 06:40:16.849672 run osmo-stp_10.42.42.5(pid=3451): Launched 06:40:17.087222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:17.680375 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3453): Launched 06:40:17.793787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:18.043515 run patchelf(pid=3454): Launched 06:40:18.208885 run osmo-stp_10.42.42.5(pid=3451): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] 06:40:18.335347 run osmo-stp_10.42.42.5(pid=3451): stdout: | (launched: 2022-12-09_06:40:16.779168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:18.462852 run osmo-stp_10.42.42.5(pid=3451): stderr: | 20221209064017076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064017077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064017077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064017077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064017078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064017078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064017078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:18.590918 run osmo-stp_10.42.42.5(pid=3451): stdout: | (launched: 2022-12-09_06:40:16.779168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:18.712583 run osmo-stp_10.42.42.5(pid=3451): stderr: | 20221209064017076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064017077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064017077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064017077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064017078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064017078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064017078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:18.856787 run patchelf(pid=3454): Terminating (SIGINT) 06:40:19.024015 run patchelf(pid=3454): Terminated: ok {rc=0} 06:40:19.144162 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3451): Process ended prematurely: osmo-stp_10.42.42.5(pid=3451) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 06:40:19.153083 tst ping.py:22: Test FAILED (6.8 sec) 06:40:19.180571 run osmo-hlr_10.42.42.2(pid=3448): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3448)] 06:40:19.228638 run osmo-hlr_10.42.42.2(pid=3448): stdout: | (launched: 2022-12-09_06:40:15.611435) 06:40:19.279052 run osmo-hlr_10.42.42.2(pid=3448): stderr: | 20221209064015807 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064015807 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064015807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064015807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064015807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064015807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064015820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064015829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064015829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064015830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:19.329292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3447): Terminating (SIGTERM) 06:40:19.369571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Terminating (SIGTERM) 06:40:19.409943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3453): Terminating (SIGTERM) 06:40:19.451035 --- ParallelTerminationStrategy: PID 3447 died... 06:40:19.470440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3447): Terminated: ok {rc=0} 06:40:19.515717 --- ParallelTerminationStrategy: PID 3450 died... 06:40:19.534775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3450): Terminated: ok {rc=0} 06:40:19.579937 --- ParallelTerminationStrategy: PID 3453 died... 06:40:19.598996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3453): Terminated: ok {rc=0} 06:40:19.684197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 06:40:20.771875 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:20.783994 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 06:40:20.856443 tst ping_idle_ping.py: using LAC 19632 06:40:20.981205 tst ping_idle_ping.py: using RAC 252 06:40:21.105919 tst ping_idle_ping.py: using CellId 19632 06:40:21.230347 tst ping_idle_ping.py: using BVCI 19633 06:40:21.347327 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.358849 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.370082 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.381901 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.393555 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.405390 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.417189 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 06:40:21.428755 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 06:40:21.546190 tst ping_idle_ping.py:24: start network... 06:40:21.762100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:22.256887 run create_hlr_db(pid=3455): Launched 06:40:22.385643 bus /gobi_6: Setting Powered False 06:40:23.445805 run create_hlr_db(pid=3455): Terminated: ok {rc=0} 06:40:23.869273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Launched 06:40:24.164821 run osmo-hlr_10.42.42.2(pid=3458): Launched 06:40:24.276889 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:24.800214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Launched 06:40:25.095752 run osmo-stp_10.42.42.5(pid=3461): Launched 06:40:25.208252 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:25.717125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3463): Launched 06:40:25.831904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:26.080688 run patchelf(pid=3464): Launched 06:40:26.246290 run osmo-stp_10.42.42.5(pid=3461): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] 06:40:26.372273 run osmo-stp_10.42.42.5(pid=3461): stdout: | (launched: 2022-12-09_06:40:25.041720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:26.499433 run osmo-stp_10.42.42.5(pid=3461): stderr: | 20221209064025211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064025211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064025212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064025212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064025213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064025213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064025213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:26.626953 run osmo-stp_10.42.42.5(pid=3461): stdout: | (launched: 2022-12-09_06:40:25.041720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:26.748220 run osmo-stp_10.42.42.5(pid=3461): stderr: | 20221209064025211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064025211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064025212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064025212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064025213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064025213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064025213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:26.891283 run patchelf(pid=3464): Terminating (SIGINT) 06:40:27.058292 run patchelf(pid=3464): Terminated: ok {rc=0} 06:40:27.178795 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3461): Process ended prematurely: osmo-stp_10.42.42.5(pid=3461) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 06:40:27.187586 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 06:40:27.214757 run osmo-hlr_10.42.42.2(pid=3458): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3458)] 06:40:27.262407 run osmo-hlr_10.42.42.2(pid=3458): stdout: | (launched: 2022-12-09_06:40:24.111046) 06:40:27.312078 run osmo-hlr_10.42.42.2(pid=3458): stderr: | 20221209064024288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064024288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064024288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064024288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064024288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064024289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064024300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064024308 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064024309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064024309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:27.362174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Terminating (SIGTERM) 06:40:27.402414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Terminating (SIGTERM) 06:40:27.442782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3463): Terminating (SIGTERM) 06:40:27.483483 --- ParallelTerminationStrategy: PID 3457 died... 06:40:27.502667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3457): Terminated: ok {rc=0} 06:40:27.547355 --- ParallelTerminationStrategy: PID 3460 died... 06:40:27.566255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3460): Terminated: ok {rc=0} 06:40:27.611138 --- ParallelTerminationStrategy: PID 3463 died... 06:40:27.629975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3463): Terminated: ok {rc=0} 06:40:27.713235 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 06:40:29.016262 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:40:29.023368 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 06:40:29.054964 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 06:40:29.093358 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 06:40:29.178074 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 06:40:29.209679 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 06:40:29.247288 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 06:40:29.846305 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 06:40:29.894561 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:29.905749 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:29.954943 tst cs_paging_gprs_active.py: using LAC 19633 06:40:30.077361 tst cs_paging_gprs_active.py: using RAC 253 06:40:30.194763 tst cs_paging_gprs_active.py: using CellId 19633 06:40:30.310256 tst cs_paging_gprs_active.py: using BVCI 19634 06:40:30.419669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.430892 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.441919 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.453137 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.464305 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.475441 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.486717 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.498058 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:30.509592 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:30.626495 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:30.744252 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 06:40:30.969274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:31.349715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3469): Launched 06:40:31.642731 run iperf3-srv_10.42.42.10(pid=3470): Launched 06:40:31.775238 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 06:40:31.994914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:32.319907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3471): Launched 06:40:32.597188 run iperf3-srv_10.42.42.10(pid=3472): Launched 06:40:32.717118 tst cs_paging_gprs_active.py:38: start network... 06:40:32.931850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:33.430228 run create_hlr_db(pid=3473): Launched 06:40:33.560764 bus /gobi_6: Setting Powered False 06:40:34.624025 run create_hlr_db(pid=3473): Terminated: ok {rc=0} 06:40:35.069716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Launched 06:40:35.388649 run osmo-hlr_10.42.42.2(pid=3476): Launched 06:40:35.510188 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:36.065201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Launched 06:40:36.384595 run osmo-stp_10.42.42.5(pid=3479): Launched 06:40:36.506512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:37.057878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3481): Launched 06:40:37.179828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:37.449155 run patchelf(pid=3482): Launched 06:40:37.626622 run osmo-stp_10.42.42.5(pid=3479): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] 06:40:37.762230 run osmo-stp_10.42.42.5(pid=3479): stdout: | (launched: 2022-12-09_06:40:36.326744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:37.900415 run osmo-stp_10.42.42.5(pid=3479): stderr: | 20221209064036518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064036518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064036518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064036519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064036519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064036519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064036519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:38.037836 run osmo-stp_10.42.42.5(pid=3479): stdout: | (launched: 2022-12-09_06:40:36.326744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:38.170430 run osmo-stp_10.42.42.5(pid=3479): stderr: | 20221209064036518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064036518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064036518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064036519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064036519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064036519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064036519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:38.326551 run patchelf(pid=3482): Terminating (SIGINT) 06:40:38.506121 run patchelf(pid=3482): Terminated: ok {rc=0} 06:40:38.635540 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3479): Process ended prematurely: osmo-stp_10.42.42.5(pid=3479) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 06:40:38.645645 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 06:40:38.673629 run osmo-hlr_10.42.42.2(pid=3476): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3476)] 06:40:38.723823 run osmo-hlr_10.42.42.2(pid=3476): stdout: | (launched: 2022-12-09_06:40:35.331014) 06:40:38.775558 run osmo-hlr_10.42.42.2(pid=3476): stderr: | 20221209064035529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064035529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064035529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064035529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064035529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064035529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064035541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064035549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064035550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064035550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:38.827919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3469): Terminating (SIGTERM) 06:40:38.870071 run iperf3-srv_10.42.42.10(pid=3470): Terminating (SIGTERM) 06:40:38.912138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3471): Terminating (SIGTERM) 06:40:38.954512 run iperf3-srv_10.42.42.10(pid=3472): Terminating (SIGTERM) 06:40:38.996592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Terminating (SIGTERM) 06:40:39.039389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Terminating (SIGTERM) 06:40:39.081662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3481): Terminating (SIGTERM) 06:40:39.123894 --- ParallelTerminationStrategy: PID 3469 died... 06:40:39.143790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3469): Terminated: ok {rc=0} 06:40:39.190256 --- ParallelTerminationStrategy: PID 3470 died... 06:40:39.209869 run iperf3-srv_10.42.42.10(pid=3470): Terminated {rc=256} 06:40:39.255822 --- ParallelTerminationStrategy: PID 3471 died... 06:40:39.275110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3471): Terminated: ok {rc=0} 06:40:39.321931 --- ParallelTerminationStrategy: PID 3472 died... 06:40:39.341521 run iperf3-srv_10.42.42.10(pid=3472): Terminated {rc=256} 06:40:39.387773 --- ParallelTerminationStrategy: PID 3475 died... 06:40:39.407254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3475): Terminated: ok {rc=0} 06:40:39.453386 --- ParallelTerminationStrategy: PID 3478 died... 06:40:39.472882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3478): Terminated: ok {rc=0} 06:40:39.519091 --- ParallelTerminationStrategy: PID 3481 died... 06:40:39.538587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3481): Terminated: ok {rc=0} 06:40:39.626429 bus /gobi_0: Setting Powered False 06:40:40.726247 bus /gobi_0: Setting Powered False 06:40:41.844137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 06:40:43.000910 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.013450 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:43.064752 tst iperf3.py: using LAC 19634 06:40:43.193044 tst iperf3.py: using RAC 254 06:40:43.320239 tst iperf3.py: using CellId 19634 06:40:43.447527 tst iperf3.py: using BVCI 19635 06:40:43.563356 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.575234 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.586997 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.599044 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.610871 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.622627 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.634449 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.646111 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:43.657980 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:43.775012 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:43.974824 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:44.270915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3483): Launched 06:40:44.528555 run iperf3-srv_10.42.42.10(pid=3484): Launched 06:40:44.639974 tst iperf3.py:8: start network... 06:40:44.838091 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:45.298650 run create_hlr_db(pid=3485): Launched 06:40:45.412511 bus /gobi_6: Setting Powered False 06:40:46.489385 run create_hlr_db(pid=3485): Terminated: ok {rc=0} 06:40:47.016927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3487): Launched 06:40:47.347254 run osmo-hlr_10.42.42.2(pid=3488): Launched 06:40:47.468799 run osmo-stp_10.42.42.5: Starting osmo-stp 06:40:48.018815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3490): Launched 06:40:48.336674 run osmo-stp_10.42.42.5(pid=3491): Launched 06:40:48.458187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:40:49.006149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3493): Launched 06:40:49.127428 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:40:49.396750 run patchelf(pid=3494): Launched 06:40:49.574118 run osmo-stp_10.42.42.5(pid=3491): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3491)] 06:40:49.709356 run osmo-stp_10.42.42.5(pid=3491): stdout: | (launched: 2022-12-09_06:40:48.279193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:49.845989 run osmo-stp_10.42.42.5(pid=3491): stderr: | 20221209064048469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064048469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064048469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064048470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064048470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064048470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064048470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:49.982946 run osmo-stp_10.42.42.5(pid=3491): stdout: | (launched: 2022-12-09_06:40:48.279193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:40:50.114897 run osmo-stp_10.42.42.5(pid=3491): stderr: | 20221209064048469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064048469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064048469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064048470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064048470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064048470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064048470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:40:50.271607 run patchelf(pid=3494): Terminating (SIGINT) 06:40:50.450796 run patchelf(pid=3494): Terminated: ok {rc=0} 06:40:50.579925 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3491): Process ended prematurely: osmo-stp_10.42.42.5(pid=3491) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3491)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 06:40:50.590112 tst iperf3.py:8: Test FAILED (7.6 sec) 06:40:50.618480 run osmo-hlr_10.42.42.2(pid=3488): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3488)] 06:40:50.668764 run osmo-hlr_10.42.42.2(pid=3488): stdout: | (launched: 2022-12-09_06:40:47.289401) 06:40:50.720809 run osmo-hlr_10.42.42.2(pid=3488): stderr: | 20221209064047486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064047486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064047486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064047486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064047486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064047486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064047498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064047506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064047507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064047507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:40:50.773369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3483): Terminating (SIGTERM) 06:40:50.815422 run iperf3-srv_10.42.42.10(pid=3484): Terminating (SIGTERM) 06:40:50.857313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3487): Terminating (SIGTERM) 06:40:50.899149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3490): Terminating (SIGTERM) 06:40:50.941151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3493): Terminating (SIGTERM) 06:40:50.983315 --- ParallelTerminationStrategy: PID 3483 died... 06:40:51.003192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3483): Terminated: ok {rc=0} 06:40:51.049180 --- ParallelTerminationStrategy: PID 3484 died... 06:40:51.068602 run iperf3-srv_10.42.42.10(pid=3484): Terminated {rc=256} 06:40:51.114356 --- ParallelTerminationStrategy: PID 3487 died... 06:40:51.133576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3487): Terminated: ok {rc=0} 06:40:51.179798 --- ParallelTerminationStrategy: PID 3490 died... 06:40:51.199238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3490): Terminated: ok {rc=0} 06:40:51.245247 --- ParallelTerminationStrategy: PID 3493 died... 06:40:51.264704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3493): Terminated: ok {rc=0} 06:40:51.351944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 06:40:52.504367 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:52.516914 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:40:52.567846 tst iperf3m4.py: using LAC 19635 06:40:52.687191 tst iperf3m4.py: using RAC 255 06:40:52.807023 tst iperf3m4.py: using CellId 19635 06:40:52.929440 tst iperf3m4.py: using BVCI 19636 06:40:53.047953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.059635 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.071150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.082785 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.094366 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.105869 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.117525 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.129075 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:40:53.140769 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:53.260089 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:53.377657 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:53.497664 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:40:53.614244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 06:40:53.814816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:54.114083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3495): Launched 06:40:54.373098 run iperf3-srv_10.42.42.10(pid=3496): Launched 06:40:54.484666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 06:40:54.683835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:54.981685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3497): Launched 06:40:55.241345 run iperf3-srv_10.42.42.10(pid=3498): Launched 06:40:55.353832 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 06:40:55.552374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:55.851196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3499): Launched 06:40:56.111218 run iperf3-srv_10.42.42.10(pid=3500): Launched 06:40:56.223378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 06:40:56.421709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 06:40:56.720465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3501): Launched 06:40:56.980295 run iperf3-srv_10.42.42.10(pid=3502): Launched 06:40:57.092449 tst iperf3m4.py:8: start network... 06:40:57.291606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:40:57.754599 run create_hlr_db(pid=3503): Launched 06:40:57.867980 bus /gobi_6: Setting Powered False 06:40:58.927043 run create_hlr_db(pid=3503): Terminated: ok {rc=0} 06:40:59.364224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3505): Launched 06:40:59.682710 run osmo-hlr_10.42.42.2(pid=3506): Launched 06:40:59.803975 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:00.351346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3508): Launched 06:41:00.670084 run osmo-stp_10.42.42.5(pid=3509): Launched 06:41:00.792150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:01.426378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3511): Launched 06:41:01.585695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:01.903219 run patchelf(pid=3512): Launched 06:41:02.098182 run osmo-stp_10.42.42.5(pid=3509): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3509)] 06:41:02.237378 run osmo-stp_10.42.42.5(pid=3509): stdout: | (launched: 2022-12-09_06:41:00.611601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:02.376878 run osmo-stp_10.42.42.5(pid=3509): stderr: | 20221209064100799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064100799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064100799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064100800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064100800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064100800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064100800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:02.514670 run osmo-stp_10.42.42.5(pid=3509): stdout: | (launched: 2022-12-09_06:41:00.611601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:02.646937 run osmo-stp_10.42.42.5(pid=3509): stderr: | 20221209064100799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064100799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064100799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064100800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064100800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064100800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064100800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:02.802966 run patchelf(pid=3512): Terminating (SIGINT) 06:41:02.981717 run patchelf(pid=3512): Terminated: ok {rc=0} 06:41:03.110708 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3509): Process ended prematurely: osmo-stp_10.42.42.5(pid=3509) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3509)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 06:41:03.120863 tst iperf3m4.py:8: Test FAILED (10.7 sec) 06:41:03.149555 run osmo-hlr_10.42.42.2(pid=3506): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3506)] 06:41:03.199878 run osmo-hlr_10.42.42.2(pid=3506): stdout: | (launched: 2022-12-09_06:40:59.625236) 06:41:03.251704 run osmo-hlr_10.42.42.2(pid=3506): stderr: | 20221209064059819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064059819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064059819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064059819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064059819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064059819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064059832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064059840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064059841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064059841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:03.303944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3495): Terminating (SIGTERM) 06:41:03.346213 run iperf3-srv_10.42.42.10(pid=3496): Terminating (SIGTERM) 06:41:03.387958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3497): Terminating (SIGTERM) 06:41:03.429853 run iperf3-srv_10.42.42.10(pid=3498): Terminating (SIGTERM) 06:41:03.471464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3499): Terminating (SIGTERM) 06:41:03.513289 run iperf3-srv_10.42.42.10(pid=3500): Terminating (SIGTERM) 06:41:03.554978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3501): Terminating (SIGTERM) 06:41:03.596844 run iperf3-srv_10.42.42.10(pid=3502): Terminating (SIGTERM) 06:41:03.638617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3505): Terminating (SIGTERM) 06:41:03.680421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3508): Terminating (SIGTERM) 06:41:03.722130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3511): Terminating (SIGTERM) 06:41:03.763918 --- ParallelTerminationStrategy: PID 3495 died... 06:41:03.784074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3495): Terminated: ok {rc=0} 06:41:03.830258 --- ParallelTerminationStrategy: PID 3496 died... 06:41:03.849868 run iperf3-srv_10.42.42.10(pid=3496): Terminated {rc=256} 06:41:03.895926 --- ParallelTerminationStrategy: PID 3497 died... 06:41:03.915397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3497): Terminated: ok {rc=0} 06:41:03.961436 --- ParallelTerminationStrategy: PID 3498 died... 06:41:03.980903 run iperf3-srv_10.42.42.10(pid=3498): Terminated {rc=256} 06:41:04.027184 --- ParallelTerminationStrategy: PID 3499 died... 06:41:04.047000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3499): Terminated: ok {rc=0} 06:41:04.093522 --- ParallelTerminationStrategy: PID 3500 died... 06:41:04.113332 run iperf3-srv_10.42.42.10(pid=3500): Terminated {rc=256} 06:41:04.159535 --- ParallelTerminationStrategy: PID 3501 died... 06:41:04.179327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3501): Terminated: ok {rc=0} 06:41:04.225626 --- ParallelTerminationStrategy: PID 3502 died... 06:41:04.244939 run iperf3-srv_10.42.42.10(pid=3502): Terminated {rc=256} 06:41:04.291115 --- ParallelTerminationStrategy: PID 3505 died... 06:41:04.310766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3505): Terminated: ok {rc=0} 06:41:04.357117 --- ParallelTerminationStrategy: PID 3508 died... 06:41:04.376694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3508): Terminated: ok {rc=0} 06:41:04.422701 --- ParallelTerminationStrategy: PID 3511 died... 06:41:04.442301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3511): Terminated: ok {rc=0} 06:41:04.530392 bus /gobi_4: Setting Powered False 06:41:05.630907 bus /gobi_4: Setting Powered False 06:41:06.746718 bus /gobi_1: Setting Powered False 06:41:07.845240 bus /gobi_1: Setting Powered False 06:41:08.962052 bus /gobi_0: Setting Powered False 06:41:10.060559 bus /gobi_0: Setting Powered False 06:41:11.177685 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 06:41:12.278968 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.290795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:41:12.340726 tst ping.py: using LAC 19636 06:41:12.456335 tst ping.py: using RAC 1 06:41:12.573698 tst ping.py: using CellId 19636 06:41:12.687647 tst ping.py: using BVCI 19637 06:41:12.792528 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.803924 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.815055 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.826422 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.837713 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.848867 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.860357 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:12.871654 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:41:12.988831 tst ping.py:19: start network... 06:41:13.200556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:13.685959 run create_hlr_db(pid=3513): Launched 06:41:13.812928 bus /gobi_6: Setting Powered False 06:41:14.876189 run create_hlr_db(pid=3513): Terminated: ok {rc=0} 06:41:15.295394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3515): Launched 06:41:15.587525 run osmo-hlr_10.42.42.2(pid=3516): Launched 06:41:15.708877 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:16.298424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3518): Launched 06:41:16.633697 run osmo-stp_10.42.42.5(pid=3519): Launched 06:41:16.903264 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:17.479995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3521): Launched 06:41:17.601398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:17.866212 run patchelf(pid=3522): Launched 06:41:18.040558 run osmo-stp_10.42.42.5(pid=3519): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3519)] 06:41:18.174057 run osmo-stp_10.42.42.5(pid=3519): stdout: | (launched: 2022-12-09_06:41:16.562476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:18.309568 run osmo-stp_10.42.42.5(pid=3519): stderr: | 20221209064116844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064116844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064116845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064116845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064116845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064116846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064116846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:18.443866 run osmo-stp_10.42.42.5(pid=3519): stdout: | (launched: 2022-12-09_06:41:16.562476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:18.572496 run osmo-stp_10.42.42.5(pid=3519): stderr: | 20221209064116844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064116844 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064116845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064116845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064116845 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064116846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064116846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:18.724491 run patchelf(pid=3522): Terminating (SIGINT) 06:41:18.900756 run patchelf(pid=3522): Terminated: ok {rc=0} 06:41:19.027918 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3519): Process ended prematurely: osmo-stp_10.42.42.5(pid=3519) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3519)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 06:41:19.037380 tst ping.py:22: Test FAILED (6.8 sec) 06:41:19.065524 run osmo-hlr_10.42.42.2(pid=3516): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3516)] 06:41:19.115614 run osmo-hlr_10.42.42.2(pid=3516): stdout: | (launched: 2022-12-09_06:41:15.533715) 06:41:19.167400 run osmo-hlr_10.42.42.2(pid=3516): stderr: | 20221209064115724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064115724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064115724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064115724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064115724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064115724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064115743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064115753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064115753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064115753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:19.219847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3515): Terminating (SIGTERM) 06:41:19.261885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3518): Terminating (SIGTERM) 06:41:19.303880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3521): Terminating (SIGTERM) 06:41:19.346043 --- ParallelTerminationStrategy: PID 3515 died... 06:41:19.365991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3515): Terminated: ok {rc=0} 06:41:19.412642 --- ParallelTerminationStrategy: PID 3518 died... 06:41:19.432284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3518): Terminated: ok {rc=0} 06:41:19.478426 --- ParallelTerminationStrategy: PID 3521 died... 06:41:19.497914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3521): Terminated: ok {rc=0} 06:41:19.584686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 06:41:20.672119 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:20.684649 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 06:41:20.735083 tst ping_idle_ping.py: using LAC 19637 06:41:20.852518 tst ping_idle_ping.py: using RAC 2 06:41:20.968549 tst ping_idle_ping.py: using CellId 19637 06:41:21.091936 tst ping_idle_ping.py: using BVCI 19638 06:41:21.208103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.219888 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.231643 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.243229 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.254878 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.266792 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.278986 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 06:41:21.291002 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 06:41:21.404731 tst ping_idle_ping.py:24: start network... 06:41:21.602687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:22.058724 run create_hlr_db(pid=3523): Launched 06:41:22.171541 bus /gobi_6: Setting Powered False 06:41:23.231450 run create_hlr_db(pid=3523): Terminated: ok {rc=0} 06:41:23.663154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Launched 06:41:23.977245 run osmo-hlr_10.42.42.2(pid=3526): Launched 06:41:24.096915 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:24.639706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Launched 06:41:24.952173 run osmo-stp_10.42.42.5(pid=3529): Launched 06:41:25.071166 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:25.611592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3531): Launched 06:41:25.731277 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:25.995062 run patchelf(pid=3532): Launched 06:41:26.169979 run osmo-stp_10.42.42.5(pid=3529): ERR: Terminated: ERROR {rc=1} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] 06:41:26.303827 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-09_06:41:24.895538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:26.438681 run osmo-stp_10.42.42.5(pid=3529): stderr: | 20221209064125086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064125086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064125087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064125087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064125087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064125087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064125087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:26.573036 run osmo-stp_10.42.42.5(pid=3529): stdout: | (launched: 2022-12-09_06:41:24.895538) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:26.701533 run osmo-stp_10.42.42.5(pid=3529): stderr: | 20221209064125086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064125086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064125087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064125087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064125087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064125087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064125087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:26.853951 run patchelf(pid=3532): Terminating (SIGINT) 06:41:27.029783 run patchelf(pid=3532): Terminated: ok {rc=0} 06:41:27.156665 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 06:41:27.166176 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 06:41:27.194340 run osmo-hlr_10.42.42.2(pid=3526): ERR: Terminated: ERROR {rc=237} [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3526)] 06:41:27.244125 run osmo-hlr_10.42.42.2(pid=3526): stdout: | (launched: 2022-12-09_06:41:23.920441) 06:41:27.295697 run osmo-hlr_10.42.42.2(pid=3526): stderr: | 20221209064124116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064124116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064124116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064124116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064124116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064124116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064124128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064124137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064124137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064124137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:27.347769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminating (SIGTERM) 06:41:27.389418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminating (SIGTERM) 06:41:27.431307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3531): Terminating (SIGTERM) 06:41:27.473288 --- ParallelTerminationStrategy: PID 3525 died... 06:41:27.493205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3525): Terminated: ok {rc=0} 06:41:27.539082 --- ParallelTerminationStrategy: PID 3528 died... 06:41:27.558477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3528): Terminated: ok {rc=0} 06:41:27.604218 --- ParallelTerminationStrategy: PID 3531 died... 06:41:27.623610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3531): Terminated: ok {rc=0} 06:41:27.710185 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 06:41:29.023362 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:29.030675 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:41:29.066528 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 06:41:29.101083 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:41:29.155310 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:41:29.188465 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 06:41:29.223113 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:41:29.783608 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2355 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 06:41:29.788806 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:29.800727 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:41:29.867644 tst switch_tch_pdch.py: using LAC 19638 06:41:29.985205 tst switch_tch_pdch.py: using RAC 3 06:41:30.108909 tst switch_tch_pdch.py: using CellId 19638 06:41:30.232463 tst switch_tch_pdch.py: using BVCI 19639 06:41:30.339408 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.351081 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.362402 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.374041 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.385718 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.397292 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.408837 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 06:41:30.420722 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:41:30.539871 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:41:30.659757 tst switch_tch_pdch.py:51: start network... 06:41:30.872828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:31.374943 run create_hlr_db(pid=3536): Launched 06:41:31.531791 bus /gobi_6: Setting Powered False 06:41:32.594583 run create_hlr_db(pid=3536): Terminated: ok {rc=0} 06:41:33.032736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3538): Launched 06:41:33.345625 run osmo-hlr_10.42.42.2(pid=3539): Launched 06:41:33.464783 run osmo-stp_10.42.42.5: Starting osmo-stp 06:41:34.009690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3541): Launched 06:41:34.324475 run osmo-stp_10.42.42.5(pid=3542): Launched 06:41:34.444387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 06:41:34.986954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3544): Launched 06:41:35.107206 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 06:41:35.372242 run patchelf(pid=3545): Launched 06:41:35.547277 run osmo-stp_10.42.42.5(pid=3542): ERR: Terminated: ERROR {rc=1} [trial-2355↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3542)] 06:41:35.680898 run osmo-stp_10.42.42.5(pid=3542): stdout: | (launched: 2022-12-09_06:41:34.267108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:35.815869 run osmo-stp_10.42.42.5(pid=3542): stderr: | 20221209064134458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064134458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064134458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064134459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064134459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064134459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064134459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:35.950937 run osmo-stp_10.42.42.5(pid=3542): stdout: | (launched: 2022-12-09_06:41:34.267108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:41:36.079953 run osmo-stp_10.42.42.5(pid=3542): stderr: | 20221209064134458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064134458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064134458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064134459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064134459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064134459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064134459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:41:36.232470 run patchelf(pid=3545): Terminating (SIGINT) 06:41:36.410011 run patchelf(pid=3545): Terminated: ok {rc=0} 06:41:36.537227 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3542): Process ended prematurely: osmo-stp_10.42.42.5(pid=3542) [trial-2355↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3542)] [trial-2355↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 06:41:36.546654 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 06:41:36.574396 run osmo-hlr_10.42.42.2(pid=3539): ERR: Terminated: ERROR {rc=237} [trial-2355↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3539)] 06:41:36.624168 run osmo-hlr_10.42.42.2(pid=3539): stdout: | (launched: 2022-12-09_06:41:33.289143) 06:41:36.675682 run osmo-hlr_10.42.42.2(pid=3539): stderr: | 20221209064133485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064133485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064133485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064133485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064133485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064133485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064133497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064133506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064133506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064133506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:41:36.727639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3538): Terminating (SIGTERM) 06:41:36.769597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3541): Terminating (SIGTERM) 06:41:36.811307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3544): Terminating (SIGTERM) 06:41:36.853370 --- ParallelTerminationStrategy: PID 3538 died... 06:41:36.873275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3538): Terminated: ok {rc=0} 06:41:36.919290 --- ParallelTerminationStrategy: PID 3541 died... 06:41:36.938634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3541): Terminated: ok {rc=0} 06:41:36.984506 --- ParallelTerminationStrategy: PID 3544 died... 06:41:37.003930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3544): Terminated: ok {rc=0} 06:41:37.091150 bus /gobi_0: Setting Powered False 06:41:38.189468 bus /gobi_0: Setting Powered False 06:41:39.305918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2355 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 nitb_smpp --------------------------------------------------------------------- 06:41:40.559963 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:40.562697 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 06:41:40.582794 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 06:41:40.591314 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 06:41:40.625458 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 06:41:40.646009 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 06:41:40.653318 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 06:41:41.171815 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2355 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:41:41.176665 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:41.195202 tst esme_connect_policy_acceptall.py: using MSISDN 7065 06:41:41.328144 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:41.883448 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3549): Launched 06:41:42.180168 run osmo-nitb_10.42.42.2(pid=3550): Launched 06:41:42.344791 run osmo-nitb_10.42.42.2(pid=3550): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3550)] 06:41:42.479423 run osmo-nitb_10.42.42.2(pid=3550): stdout: | (launched: 2022-12-09_06:41:42.126627) 06:41:42.615516 run osmo-nitb_10.42.42.2(pid=3550): stderr: | (launched: 2022-12-09_06:41:42.170675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:42.751558 run osmo-nitb_10.42.42.2(pid=3550): stdout: | (launched: 2022-12-09_06:41:42.126627) 06:41:42.881478 run osmo-nitb_10.42.42.2(pid=3550): stderr: | (launched: 2022-12-09_06:41:42.170675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3550) [trial-2355↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3550)] 06:41:43.292160 tst osmo-nitb_10.42.42.2(pid=3550): stdout: | (launched: 2022-12-09_06:41:42.126627) 06:41:43.414524 tst osmo-nitb_10.42.42.2(pid=3550): stderr: | (launched: 2022-12-09_06:41:42.170675) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:43.557444 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=3550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3550) [trial-2355↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3550)] [trial-2355↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 06:41:43.565684 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 06:41:43.572192 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3549): Terminating (SIGTERM) 06:41:43.782151 --- ParallelTerminationStrategy: PID 3549 died... 06:41:43.802952 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3549): Terminated: ok {rc=0} ---------------------------------------------- trial-2355 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 06:41:43.852000 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:43.872730 tst esme_connect_policy_closed.py: using MSISDN 7066 06:41:43.992901 tst esme_connect_policy_closed.py: using MSISDN 7067 06:41:44.100153 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:44.656832 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3551): Launched 06:41:44.954935 run osmo-nitb_10.42.42.2(pid=3552): Launched 06:41:45.115206 run osmo-nitb_10.42.42.2(pid=3552): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3552)] 06:41:45.238260 run osmo-nitb_10.42.42.2(pid=3552): stdout: | (launched: 2022-12-09_06:41:44.901155) 06:41:45.362886 run osmo-nitb_10.42.42.2(pid=3552): stderr: | (launched: 2022-12-09_06:41:44.945567) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:45.487951 run osmo-nitb_10.42.42.2(pid=3552): stdout: | (launched: 2022-12-09_06:41:44.901155) 06:41:45.606553 run osmo-nitb_10.42.42.2(pid=3552): stderr: | (launched: 2022-12-09_06:41:44.945567) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:45.748755 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=3552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3552) [trial-2355↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3552)] [trial-2355↪nitb_smpp↪esme_connect_policy_closed.py:24] 06:41:45.757190 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 06:41:45.763540 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3551): Terminating (SIGTERM) 06:41:45.972290 --- ParallelTerminationStrategy: PID 3551 died... 06:41:45.995681 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3551): Terminated: ok {rc=0} ---------------------------------------------- trial-2355 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:41:46.057846 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:46.072261 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:41:46.113254 tst esme_ms_sms_storeforward.py: using LAC 19639 06:41:46.263627 tst esme_ms_sms_storeforward.py: using RAC 4 06:41:46.382640 tst esme_ms_sms_storeforward.py: using CellId 19639 06:41:46.515165 tst esme_ms_sms_storeforward.py: using BVCI 19640 06:41:46.654480 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:41:46.780599 tst esme_ms_sms_storeforward.py: using MSISDN 7068 06:41:46.930690 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 06:41:47.164594 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:47.824733 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3553): Launched 06:41:48.146493 run osmo-nitb_10.42.42.2(pid=3554): Launched 06:41:48.319705 run osmo-nitb_10.42.42.2(pid=3554): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3554)] 06:41:48.453334 run osmo-nitb_10.42.42.2(pid=3554): stdout: | (launched: 2022-12-09_06:41:48.088653) 06:41:48.587295 run osmo-nitb_10.42.42.2(pid=3554): stderr: | (launched: 2022-12-09_06:41:48.136681) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:48.721732 run osmo-nitb_10.42.42.2(pid=3554): stdout: | (launched: 2022-12-09_06:41:48.088653) 06:41:48.849665 run osmo-nitb_10.42.42.2(pid=3554): stderr: | (launched: 2022-12-09_06:41:48.136681) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:49.002948 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=3554): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3554) [trial-2355↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3554)] [trial-2355↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 06:41:49.011557 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 06:41:49.018409 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3553): Terminating (SIGTERM) 06:41:49.230350 --- ParallelTerminationStrategy: PID 3553 died... 06:41:49.252036 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3553): Terminated: ok {rc=0} 06:41:49.340478 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:41:50.429439 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 06:41:50.441126 tst nitb_smpp: Using 1 x bts (candidates: 1) 06:41:50.478046 tst esme_ms_sms_transaction.py: using LAC 19640 06:41:50.608505 tst esme_ms_sms_transaction.py: using RAC 5 06:41:50.733417 tst esme_ms_sms_transaction.py: using CellId 19640 06:41:50.858772 tst esme_ms_sms_transaction.py: using BVCI 19641 06:41:50.974443 tst nitb_smpp: Using 1 x modem (candidates: 1) 06:41:51.096929 tst esme_ms_sms_transaction.py: using MSISDN 7069 06:41:51.204940 tst esme_ms_sms_transaction.py:18: start nitb and bts... 06:41:51.405101 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:41:52.012307 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3555): Launched 06:41:52.310570 run osmo-nitb_10.42.42.2(pid=3556): Launched 06:41:52.476668 run osmo-nitb_10.42.42.2(pid=3556): ERR: Terminated: ERROR {rc=2} [trial-2355↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3556)] 06:41:52.611217 run osmo-nitb_10.42.42.2(pid=3556): stdout: | (launched: 2022-12-09_06:41:52.256865) 06:41:52.747367 run osmo-nitb_10.42.42.2(pid=3556): stderr: | (launched: 2022-12-09_06:41:52.301150) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:52.883622 run osmo-nitb_10.42.42.2(pid=3556): stdout: | (launched: 2022-12-09_06:41:52.256865) 06:41:53.013739 run osmo-nitb_10.42.42.2(pid=3556): stderr: | (launched: 2022-12-09_06:41:52.301150) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f8a70371268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3556) [trial-2355↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3556)] 06:41:53.423114 tst osmo-nitb_10.42.42.2(pid=3556): stdout: | (launched: 2022-12-09_06:41:52.256865) 06:41:53.542973 tst osmo-nitb_10.42.42.2(pid=3556): stderr: | (launched: 2022-12-09_06:41:52.301150) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:41:53.685479 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=3556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3556) [trial-2355↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3556)] [trial-2355↪nitb_smpp↪esme_ms_sms_transaction.py:21] 06:41:53.693913 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 06:41:53.700518 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3555): Terminating (SIGTERM) 06:41:53.910044 --- ParallelTerminationStrategy: PID 3555 died... 06:41:53.931034 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3555): Terminated: ok {rc=0} 06:41:54.016807 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 smpp --------------------------------------------------------------------- 06:41:55.179826 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:41:55.182657 tst smpp: Verifying 1 x bts (candidates: 11) 06:41:55.202867 tst smpp: Verifying 6 x ip_address (candidates: 9) 06:41:55.230116 tst smpp: Verifying 1 x modem (candidates: 12) 06:41:55.265406 tst smpp: Reserving 1 x bts (candidates: 11) 06:41:55.286374 tst smpp: Reserving 6 x ip_address (candidates: 9) 06:41:55.313190 tst smpp: Reserving 1 x modem (candidates: 12) 06:41:55.839661 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 06:41:55.845139 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:55.855850 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:55.866603 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:55.877958 tst smpp: Using 1 x ip_address (candidates: 6) 06:41:55.896935 tst esme_connect_policy_acceptall.py: using MSISDN 7070 06:41:56.013664 run osmo-stp_10.42.42.4: Starting osmo-stp 06:41:56.558580 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3560): Launched 06:41:56.877357 run osmo-stp_10.42.42.4(pid=3561): Launched 06:41:56.999057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:41:57.497210 run create_hlr_db(pid=3562): Launched 06:41:57.629118 bus /sierra_2: Setting Powered False 06:41:58.693689 run create_hlr_db(pid=3562): Terminated: ok {rc=0} 06:41:59.145980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Launched 06:41:59.471025 run osmo-hlr_10.42.42.2(pid=3565): Launched 06:41:59.593945 run osmo-msc_10.42.42.5: Starting osmo-msc 06:42:00.182335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Launched 06:42:00.507754 run osmo-msc_10.42.42.5(pid=3568): Launched 06:42:00.688374 run osmo-hlr_10.42.42.2(pid=3565): ERR: Terminated: ERROR {rc=237} [trial-2355↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3565)] 06:42:00.828019 run osmo-hlr_10.42.42.2(pid=3565): stdout: | (launched: 2022-12-09_06:41:59.412226) 06:42:01.185306 run osmo-hlr_10.42.42.2(pid=3565): stderr: | 20221209064159605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064159605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064159619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064159628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064159628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064159628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:01.427122 run osmo-hlr_10.42.42.2(pid=3565): stdout: | (launched: 2022-12-09_06:41:59.412226) 06:42:01.592899 run osmo-hlr_10.42.42.2(pid=3565): stderr: | 20221209064159605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064159605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064159605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064159619 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064159628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064159628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064159628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:01.756152 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=3565): Process ended prematurely: osmo-hlr_10.42.42.2(pid=3565) [trial-2355↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3565)] [trial-2355↪smpp↪esme_connect_policy_acceptall.py:23] 06:42:01.765885 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.9 sec) 06:42:01.794857 run osmo-msc_10.42.42.5(pid=3568): ERR: Terminated: ERROR {rc=9} [trial-2355↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=3568)] 06:42:01.848534 run osmo-msc_10.42.42.5(pid=3568): stdout: | (launched: 2022-12-09_06:42:00.448779) 06:42:01.904115 run osmo-msc_10.42.42.5(pid=3568): stderr: | 20221209064200810 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209064200810 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209064200810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064200810 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209064200810 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209064200811 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209064200811 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209064200811 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209064200811 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:42:01.959315 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3560): Terminating (SIGTERM) 06:42:02.003864 run osmo-stp_10.42.42.4(pid=3561): Terminating (SIGTERM) 06:42:02.048245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Terminating (SIGTERM) 06:42:02.121772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Terminating (SIGTERM) 06:42:02.212196 --- ParallelTerminationStrategy: PID 3560 died... 06:42:02.233154 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3560): Terminated: ok {rc=0} 06:42:02.281670 --- ParallelTerminationStrategy: PID 3561 died... 06:42:02.302339 run osmo-stp_10.42.42.4(pid=3561): Terminated: ok {rc=0} 06:42:02.350888 --- ParallelTerminationStrategy: PID 3564 died... 06:42:02.370835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3564): Terminated: ok {rc=0} 06:42:02.417804 --- ParallelTerminationStrategy: PID 3567 died... 06:42:02.437703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3567): Terminated: ok {rc=0} ---------------------------------------------- trial-2355 smpp esme_connect_policy_closed.py ---------------------------------------------- 06:42:02.489362 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:02.500936 tst smpp: Using 1 x bts (candidates: 1) 06:42:02.537600 tst esme_connect_policy_closed.py: using LAC 19641 06:42:02.666178 tst esme_connect_policy_closed.py: using RAC 6 06:42:02.793402 tst esme_connect_policy_closed.py: using CellId 19641 06:42:02.927731 tst esme_connect_policy_closed.py: using BVCI 19642 06:42:03.046241 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:03.057359 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:03.067931 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:03.086072 tst esme_connect_policy_closed.py: using MSISDN 7071 06:42:03.218818 tst esme_connect_policy_closed.py: using MSISDN 7072 06:42:03.337478 run osmo-stp_10.42.42.4: Starting osmo-stp 06:42:03.890157 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3581): Launched 06:42:04.215443 run osmo-stp_10.42.42.4(pid=3582): Launched 06:42:04.339407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:04.844126 run create_hlr_db(pid=3583): Launched 06:42:06.033365 run create_hlr_db(pid=3583): Terminated: ok {rc=0} 06:42:06.378177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3585): Launched 06:42:06.704038 run osmo-hlr_10.42.42.2(pid=3586): Launched 06:42:06.827154 run osmo-msc_10.42.42.5: Starting osmo-msc 06:42:07.422569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3588): Launched 06:42:07.748840 run osmo-msc_10.42.42.5(pid=3589): Launched 06:42:07.929883 run osmo-hlr_10.42.42.2(pid=3586): ERR: Terminated: ERROR {rc=237} [trial-2355↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3586)] 06:42:08.068227 run osmo-hlr_10.42.42.2(pid=3586): stdout: | (launched: 2022-12-09_06:42:06.645475) 06:42:08.207201 run osmo-hlr_10.42.42.2(pid=3586): stderr: | 20221209064206838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064206838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064206850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064206859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064206859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064206859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:08.344705 run osmo-hlr_10.42.42.2(pid=3586): stdout: | (launched: 2022-12-09_06:42:06.645475) 06:42:08.474430 run osmo-hlr_10.42.42.2(pid=3586): stderr: | 20221209064206838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064206838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064206838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064206850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064206859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064206859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064206859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:08.630273 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=3586): Process ended prematurely: osmo-hlr_10.42.42.2(pid=3586) [trial-2355↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3586)] [trial-2355↪smpp↪esme_connect_policy_closed.py:31] 06:42:08.639033 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec) 06:42:08.666339 run osmo-msc_10.42.42.5(pid=3589): ERR: Terminated: ERROR {rc=9} [trial-2355↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=3589)] 06:42:08.716789 run osmo-msc_10.42.42.5(pid=3589): stdout: | (launched: 2022-12-09_06:42:07.689763) 06:42:08.768931 run osmo-msc_10.42.42.5(pid=3589): stderr: | 20221209064208053 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209064208053 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209064208053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064208053 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209064208053 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209064208053 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209064208053 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209064208054 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209064208054 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 06:42:08.821175 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3581): Terminating (SIGTERM) 06:42:08.863141 run osmo-stp_10.42.42.4(pid=3582): Terminating (SIGTERM) 06:42:08.905135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3585): Terminating (SIGTERM) 06:42:08.948634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3588): Terminating (SIGTERM) 06:42:08.994376 --- ParallelTerminationStrategy: PID 3581 died... 06:42:09.015312 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3581): Terminated: ok {rc=0} 06:42:09.064008 --- ParallelTerminationStrategy: PID 3582 died... 06:42:09.083554 run osmo-stp_10.42.42.4(pid=3582): Terminated: ok {rc=0} 06:42:09.129603 --- ParallelTerminationStrategy: PID 3585 died... 06:42:09.149041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3585): Terminated: ok {rc=0} 06:42:09.195366 --- ParallelTerminationStrategy: PID 3588 died... 06:42:09.215217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3588): Terminated: ok {rc=0} ---------------------------------------------- trial-2355 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 06:42:09.266107 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.277586 tst smpp: Using 1 x bts (candidates: 1) 06:42:09.313217 tst esme_ms_sms_storeforward.py: using LAC 19642 06:42:09.442528 tst esme_ms_sms_storeforward.py: using RAC 7 06:42:09.570369 tst esme_ms_sms_storeforward.py: using CellId 19642 06:42:09.698429 tst esme_ms_sms_storeforward.py: using BVCI 19643 06:42:09.816561 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.827489 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.838285 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.849146 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.859769 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:09.870440 tst smpp: Using 1 x modem (candidates: 1) 06:42:10.001315 tst esme_ms_sms_storeforward.py: using MSISDN 7073 06:42:10.120541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:10.625221 run create_hlr_db(pid=3592): Launched 06:42:11.814582 run create_hlr_db(pid=3592): Terminated: ok {rc=0} 06:42:12.157245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Launched 06:42:12.482135 run osmo-hlr_10.42.42.2(pid=3595): Launched 06:42:12.606307 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:13.166617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Launched 06:42:13.493040 run osmo-stp_10.42.42.5(pid=3598): Launched 06:42:13.618048 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:14.205948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Launched 06:42:14.531271 run osmo-msc_10.42.42.6(pid=3601): Launched 06:42:14.711919 run osmo-stp_10.42.42.5(pid=3598): ERR: Terminated: ERROR {rc=1} [trial-2355↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] 06:42:14.848886 run osmo-stp_10.42.42.5(pid=3598): stdout: | (launched: 2022-12-09_06:42:13.434120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:14.986500 run osmo-stp_10.42.42.5(pid=3598): stderr: | 20221209064213625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064213627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064213627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064213628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064213628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064213628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064213629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:15.123391 run osmo-stp_10.42.42.5(pid=3598): stdout: | (launched: 2022-12-09_06:42:13.434120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:15.253083 run osmo-stp_10.42.42.5(pid=3598): stderr: | 20221209064213625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064213627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064213627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064213628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064213628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064213628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064213629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:15.407918 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=3598): Process ended prematurely: osmo-stp_10.42.42.5(pid=3598) [trial-2355↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] [trial-2355↪smpp↪esme_ms_sms_storeforward.py:30] 06:42:15.416638 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 06:42:15.443978 run osmo-hlr_10.42.42.2(pid=3595): ERR: Terminated: ERROR {rc=237} [trial-2355↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3595)] 06:42:15.494073 run osmo-hlr_10.42.42.2(pid=3595): stdout: | (launched: 2022-12-09_06:42:12.423530) 06:42:15.545877 run osmo-hlr_10.42.42.2(pid=3595): stderr: | 20221209064212621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064212621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064212621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064212621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064212621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064212621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064212633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064212642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064212642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064212642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:15.617951 run osmo-msc_10.42.42.6(pid=3601): ERR: Terminated: ERROR {rc=2} [trial-2355↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3601)] 06:42:15.668329 run osmo-msc_10.42.42.6(pid=3601): stdout: | (launched: 2022-12-09_06:42:14.472400) 06:42:15.719995 run osmo-msc_10.42.42.6(pid=3601): stderr: | 20221209064214796 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064214797 DLGLOBAL DEBUG validating counter group 0x7f2db9f17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064214797 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064214797 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064214797 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064214797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064214799 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064214800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064214800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064214800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:15.771992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Terminating (SIGTERM) 06:42:15.814027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Terminating (SIGTERM) 06:42:15.856276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminating (SIGTERM) 06:42:15.910931 --- ParallelTerminationStrategy: PID 3594 died... 06:42:15.930915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3594): Terminated: ok {rc=0} 06:42:15.988773 --- ParallelTerminationStrategy: PID 3597 died... 06:42:16.009011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3597): Terminated: ok {rc=0} 06:42:16.063855 --- ParallelTerminationStrategy: PID 3600 died... 06:42:16.088276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminated: ok {rc=0} 06:42:16.195883 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 smpp esme_ms_sms_transaction.py ---------------------------------------------- 06:42:17.295169 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.306411 tst smpp: Using 1 x bts (candidates: 1) 06:42:17.344888 tst esme_ms_sms_transaction.py: using LAC 19643 06:42:17.467261 tst esme_ms_sms_transaction.py: using RAC 8 06:42:17.591749 tst esme_ms_sms_transaction.py: using CellId 19643 06:42:17.710408 tst esme_ms_sms_transaction.py: using BVCI 19644 06:42:17.822591 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.833162 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.843603 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.854798 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.866067 tst smpp: Using 1 x ip_address (candidates: 6) 06:42:17.876878 tst smpp: Using 1 x modem (candidates: 1) 06:42:18.002474 tst esme_ms_sms_transaction.py: using MSISDN 7074 06:42:18.112605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:18.580577 run create_hlr_db(pid=3603): Launched 06:42:18.696035 bus /sierra_2: Setting Powered False 06:42:19.757052 run create_hlr_db(pid=3603): Terminated: ok {rc=0} 06:42:20.202773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Launched 06:42:20.530330 run osmo-hlr_10.42.42.2(pid=3606): Launched 06:42:20.655815 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:21.214382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Launched 06:42:21.539188 run osmo-stp_10.42.42.5(pid=3609): Launched 06:42:21.663186 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:22.250681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Launched 06:42:22.576098 run osmo-msc_10.42.42.6(pid=3612): Launched 06:42:22.759468 run osmo-stp_10.42.42.5(pid=3609): ERR: Terminated: ERROR {rc=1} [trial-2355↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] 06:42:22.896369 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-09_06:42:21.480226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:23.034163 run osmo-stp_10.42.42.5(pid=3609): stderr: | 20221209064221676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064221676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064221676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064221677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064221677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064221677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064221677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:23.170880 run osmo-stp_10.42.42.5(pid=3609): stdout: | (launched: 2022-12-09_06:42:21.480226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:23.301300 run osmo-stp_10.42.42.5(pid=3609): stderr: | 20221209064221676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064221676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064221676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064221677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064221677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064221677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064221677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:23.456611 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2355↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] [trial-2355↪smpp↪esme_ms_sms_transaction.py:28] 06:42:23.465499 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 06:42:23.492989 run osmo-hlr_10.42.42.2(pid=3606): ERR: Terminated: ERROR {rc=237} [trial-2355↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3606)] 06:42:23.543104 run osmo-hlr_10.42.42.2(pid=3606): stdout: | (launched: 2022-12-09_06:42:20.471339) 06:42:23.595228 run osmo-hlr_10.42.42.2(pid=3606): stderr: | 20221209064220671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064220671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064220671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064220671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064220671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064220671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064220684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064220692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064220692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064220692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:23.667921 run osmo-msc_10.42.42.6(pid=3612): ERR: Terminated: ERROR {rc=2} [trial-2355↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3612)] 06:42:23.717899 run osmo-msc_10.42.42.6(pid=3612): stdout: | (launched: 2022-12-09_06:42:22.517247) 06:42:23.770039 run osmo-msc_10.42.42.6(pid=3612): stderr: | 20221209064222842 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064222842 DLGLOBAL DEBUG validating counter group 0x7fca40b4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064222842 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064222842 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064222842 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064222843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064222845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064222845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064222845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064222845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:23.822479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminating (SIGTERM) 06:42:23.864253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminating (SIGTERM) 06:42:23.906406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminating (SIGTERM) 06:42:23.949117 --- ParallelTerminationStrategy: PID 3605 died... 06:42:23.969132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3605): Terminated: ok {rc=0} 06:42:24.016036 --- ParallelTerminationStrategy: PID 3608 died... 06:42:24.036029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3608): Terminated: ok {rc=0} 06:42:24.082795 --- ParallelTerminationStrategy: PID 3611 died... 06:42:24.102765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3611): Terminated: ok {rc=0} 06:42:24.192136 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 encryption --------------------------------------------------------------------- 06:42:25.389576 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:42:25.392506 tst encryption: Verifying 1 x bts (candidates: 11) 06:42:25.413857 tst encryption: Verifying 6 x ip_address (candidates: 9) 06:42:25.441414 tst encryption: Verifying 1 x modem (candidates: 12) 06:42:25.477916 tst encryption: Reserving 1 x bts (candidates: 11) 06:42:25.499399 tst encryption: Reserving 6 x ip_address (candidates: 9) 06:42:25.526457 tst encryption: Reserving 1 x modem (candidates: 12) 06:42:26.055290 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2355 encryption register_a5_0_authopt.py ---------------------------------------------- 06:42:26.110101 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.121132 tst encryption: Using 1 x bts (candidates: 1) 06:42:26.157339 tst register_a5_0_authopt.py: using LAC 19644 06:42:26.287846 tst register_a5_0_authopt.py: using RAC 9 06:42:26.418710 tst register_a5_0_authopt.py: using CellId 19644 06:42:26.549093 tst register_a5_0_authopt.py: using BVCI 19645 06:42:26.670028 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.680763 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.691535 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.702456 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.713390 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:26.724216 tst encryption: Using 1 x modem (candidates: 1) 06:42:26.837839 tst register_a5_0_authopt.py:8: start network... 06:42:27.045198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:27.521424 run create_hlr_db(pid=3617): Launched 06:42:27.639994 bus /sierra_2: Setting Powered False 06:42:28.701708 run create_hlr_db(pid=3617): Terminated: ok {rc=0} 06:42:29.128729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Launched 06:42:29.435702 run osmo-hlr_10.42.42.2(pid=3620): Launched 06:42:29.552887 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:30.095868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Launched 06:42:30.403350 run osmo-stp_10.42.42.5(pid=3623): Launched 06:42:30.519948 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:31.121865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Launched 06:42:31.470516 run osmo-msc_10.42.42.6(pid=3626): Launched 06:42:31.789552 run osmo-stp_10.42.42.5(pid=3623): ERR: Terminated: ERROR {rc=1} [trial-2355↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] 06:42:32.015297 run osmo-stp_10.42.42.5(pid=3623): stdout: | (launched: 2022-12-09_06:42:30.347802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:32.260851 run osmo-stp_10.42.42.5(pid=3623): stderr: | 20221209064230518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064230518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064230519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064230519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064230520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064230520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064230520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:32.398237 run osmo-stp_10.42.42.5(pid=3623): stdout: | (launched: 2022-12-09_06:42:30.347802) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:32.529607 run osmo-stp_10.42.42.5(pid=3623): stderr: | 20221209064230518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064230518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064230519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064230519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064230520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064230520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064230520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:32.686545 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3623): Process ended prematurely: osmo-stp_10.42.42.5(pid=3623) [trial-2355↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] [trial-2355↪encryption↪register_a5_0_authopt.py:8] 06:42:32.696224 tst register_a5_0_authopt.py:8: Test FAILED (6.6 sec) 06:42:32.724343 run osmo-hlr_10.42.42.2(pid=3620): ERR: Terminated: ERROR {rc=237} [trial-2355↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3620)] 06:42:32.775761 run osmo-hlr_10.42.42.2(pid=3620): stdout: | (launched: 2022-12-09_06:42:29.379824) 06:42:32.828284 run osmo-hlr_10.42.42.2(pid=3620): stderr: | 20221209064229553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064229553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064229553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064229553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064229553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064229553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064229566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064229574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064229575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064229575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:32.903201 run osmo-msc_10.42.42.6(pid=3626): ERR: Terminated: ERROR {rc=2} [trial-2355↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3626)] 06:42:32.953742 run osmo-msc_10.42.42.6(pid=3626): stdout: | (launched: 2022-12-09_06:42:31.401992) 06:42:33.006045 run osmo-msc_10.42.42.6(pid=3626): stderr: | 20221209064231939 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064231939 DLGLOBAL DEBUG validating counter group 0x7f7e81c65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064231939 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064231939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064231939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064231939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064231949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064231950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064231950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064231950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:33.058599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Terminating (SIGTERM) 06:42:33.101125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Terminating (SIGTERM) 06:42:33.143892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Terminating (SIGTERM) 06:42:33.186915 --- ParallelTerminationStrategy: PID 3619 died... 06:42:33.207179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3619): Terminated: ok {rc=0} 06:42:33.255251 --- ParallelTerminationStrategy: PID 3622 died... 06:42:33.275311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3622): Terminated: ok {rc=0} 06:42:33.322463 --- ParallelTerminationStrategy: PID 3625 died... 06:42:33.342504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3625): Terminated: ok {rc=0} 06:42:33.431161 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 encryption register_a5_0_authreq.py ---------------------------------------------- 06:42:34.583188 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:34.594297 tst encryption: Using 1 x bts (candidates: 1) 06:42:34.628030 tst register_a5_0_authreq.py: using LAC 19645 06:42:34.761821 tst register_a5_0_authreq.py: using RAC 10 06:42:34.891164 tst register_a5_0_authreq.py: using CellId 19645 06:42:35.019368 tst register_a5_0_authreq.py: using BVCI 19646 06:42:35.140842 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:35.151862 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:35.162698 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:35.174073 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:35.185391 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:35.196618 tst encryption: Using 1 x modem (candidates: 1) 06:42:35.315026 tst register_a5_0_authreq.py:8: start network... 06:42:35.521679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:35.998688 run create_hlr_db(pid=3628): Launched 06:42:36.115917 bus /sierra_2: Setting Powered False 06:42:37.176432 run create_hlr_db(pid=3628): Terminated: ok {rc=0} 06:42:37.626831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Launched 06:42:37.956222 run osmo-hlr_10.42.42.2(pid=3631): Launched 06:42:38.082822 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:38.649737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Launched 06:42:38.979004 run osmo-stp_10.42.42.5(pid=3634): Launched 06:42:39.103910 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:39.698445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Launched 06:42:40.027758 run osmo-msc_10.42.42.6(pid=3637): Launched 06:42:40.210235 run osmo-stp_10.42.42.5(pid=3634): ERR: Terminated: ERROR {rc=1} [trial-2355↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] 06:42:40.355008 run osmo-stp_10.42.42.5(pid=3634): stdout: | (launched: 2022-12-09_06:42:38.919381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:40.491813 run osmo-stp_10.42.42.5(pid=3634): stderr: | 20221209064239114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064239114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064239115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064239115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064239116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064239116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064239116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:40.628770 run osmo-stp_10.42.42.5(pid=3634): stdout: | (launched: 2022-12-09_06:42:38.919381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:40.759205 run osmo-stp_10.42.42.5(pid=3634): stderr: | 20221209064239114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064239114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064239115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064239115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064239116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064239116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064239116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:40.915556 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3634): Process ended prematurely: osmo-stp_10.42.42.5(pid=3634) [trial-2355↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] [trial-2355↪encryption↪register_a5_0_authreq.py:8] 06:42:40.925114 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 06:42:40.952734 run osmo-hlr_10.42.42.2(pid=3631): ERR: Terminated: ERROR {rc=237} [trial-2355↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3631)] 06:42:41.002733 run osmo-hlr_10.42.42.2(pid=3631): stdout: | (launched: 2022-12-09_06:42:37.896375) 06:42:41.054231 run osmo-hlr_10.42.42.2(pid=3631): stderr: | 20221209064238102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064238102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064238102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064238102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064238102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064238102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064238115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064238123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064238123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064238123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:41.126152 run osmo-msc_10.42.42.6(pid=3637): ERR: Terminated: ERROR {rc=2} [trial-2355↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3637)] 06:42:41.176332 run osmo-msc_10.42.42.6(pid=3637): stdout: | (launched: 2022-12-09_06:42:39.967729) 06:42:41.228454 run osmo-msc_10.42.42.6(pid=3637): stderr: | 20221209064240292 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064240293 DLGLOBAL DEBUG validating counter group 0x7ff449e74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064240293 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064240293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064240293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064240293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064240295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064240295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064240295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064240295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:41.280650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Terminating (SIGTERM) 06:42:41.322557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Terminating (SIGTERM) 06:42:41.364618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Terminating (SIGTERM) 06:42:41.407024 --- ParallelTerminationStrategy: PID 3630 died... 06:42:41.427104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3630): Terminated: ok {rc=0} 06:42:41.473706 --- ParallelTerminationStrategy: PID 3633 died... 06:42:41.493498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3633): Terminated: ok {rc=0} 06:42:41.539963 --- ParallelTerminationStrategy: PID 3636 died... 06:42:41.559699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3636): Terminated: ok {rc=0} 06:42:41.646798 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 encryption register_a5_1_authreq.py ---------------------------------------------- 06:42:42.794089 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:42.805289 tst encryption: Using 1 x bts (candidates: 1) 06:42:42.841774 tst register_a5_1_authreq.py: using LAC 19646 06:42:42.973357 tst register_a5_1_authreq.py: using RAC 11 06:42:43.103950 tst register_a5_1_authreq.py: using CellId 19646 06:42:43.234747 tst register_a5_1_authreq.py: using BVCI 19647 06:42:43.355581 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:43.366792 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:43.377869 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:43.389426 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:43.400940 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:43.412273 tst encryption: Using 1 x modem (candidates: 1) 06:42:43.533882 tst register_a5_1_authreq.py:8: start network... 06:42:43.757989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:44.268355 run create_hlr_db(pid=3639): Launched 06:42:44.402701 bus /sierra_2: Setting Powered False 06:42:45.467118 run create_hlr_db(pid=3639): Terminated: ok {rc=0} 06:42:45.937763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Launched 06:42:46.269145 run osmo-hlr_10.42.42.2(pid=3642): Launched 06:42:46.419715 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:47.131063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Launched 06:42:47.491235 run osmo-stp_10.42.42.5(pid=3645): Launched 06:42:47.616570 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:48.210652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3647): Launched 06:42:48.540806 run osmo-msc_10.42.42.6(pid=3648): Launched 06:42:48.724641 run osmo-stp_10.42.42.5(pid=3645): ERR: Terminated: ERROR {rc=1} [trial-2355↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] 06:42:48.864249 run osmo-stp_10.42.42.5(pid=3645): stdout: | (launched: 2022-12-09_06:42:47.431238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:49.005354 run osmo-stp_10.42.42.5(pid=3645): stderr: | 20221209064247623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064247623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064247623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064247624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064247624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064247624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064247624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:49.143669 run osmo-stp_10.42.42.5(pid=3645): stdout: | (launched: 2022-12-09_06:42:47.431238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:49.275111 run osmo-stp_10.42.42.5(pid=3645): stderr: | 20221209064247623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064247623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064247623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064247624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064247624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064247624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064247624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:49.431471 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3645): Process ended prematurely: osmo-stp_10.42.42.5(pid=3645) [trial-2355↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] [trial-2355↪encryption↪register_a5_1_authreq.py:8] 06:42:49.441114 tst register_a5_1_authreq.py:8: Test FAILED (6.7 sec) 06:42:49.468765 run osmo-hlr_10.42.42.2(pid=3642): ERR: Terminated: ERROR {rc=237} [trial-2355↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3642)] 06:42:49.518865 run osmo-hlr_10.42.42.2(pid=3642): stdout: | (launched: 2022-12-09_06:42:46.203877) 06:42:49.570709 run osmo-hlr_10.42.42.2(pid=3642): stderr: | 20221209064246625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064246625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064246625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064246625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064246625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064246625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064246667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064246689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064246689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064246689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:49.643359 run osmo-msc_10.42.42.6(pid=3648): ERR: Terminated: ERROR {rc=2} [trial-2355↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3648)] 06:42:49.693367 run osmo-msc_10.42.42.6(pid=3648): stdout: | (launched: 2022-12-09_06:42:48.481072) 06:42:49.745361 run osmo-msc_10.42.42.6(pid=3648): stderr: | 20221209064248806 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064248806 DLGLOBAL DEBUG validating counter group 0x7f6517b29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064248806 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064248806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064248806 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064248807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064248808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064248809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064248809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064248809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:49.797517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Terminating (SIGTERM) 06:42:49.839324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Terminating (SIGTERM) 06:42:49.881344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3647): Terminating (SIGTERM) 06:42:49.923428 --- ParallelTerminationStrategy: PID 3641 died... 06:42:49.943488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3641): Terminated: ok {rc=0} 06:42:49.989764 --- ParallelTerminationStrategy: PID 3644 died... 06:42:50.009411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3644): Terminated: ok {rc=0} 06:42:50.055382 --- ParallelTerminationStrategy: PID 3647 died... 06:42:50.075013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3647): Terminated: ok {rc=0} 06:42:50.162705 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2355 encryption register_a5_3_authreq.py ---------------------------------------------- 06:42:51.315441 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.327136 tst encryption: Using 1 x bts (candidates: 1) 06:42:51.364004 tst register_a5_3_authreq.py: using LAC 19647 06:42:51.496110 tst register_a5_3_authreq.py: using RAC 12 06:42:51.627374 tst register_a5_3_authreq.py: using CellId 19647 06:42:51.758766 tst register_a5_3_authreq.py: using BVCI 19648 06:42:51.879803 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.902368 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.920285 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.936510 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.947461 tst encryption: Using 1 x ip_address (candidates: 6) 06:42:51.958377 tst encryption: Using 1 x modem (candidates: 1) 06:42:52.083165 tst register_a5_3_authreq.py:8: start network... 06:42:52.290470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:42:52.766201 run create_hlr_db(pid=3650): Launched 06:42:52.885242 bus /sierra_2: Setting Powered False 06:42:53.946111 run create_hlr_db(pid=3650): Terminated: ok {rc=0} 06:42:54.372838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3652): Launched 06:42:54.679514 run osmo-hlr_10.42.42.2(pid=3653): Launched 06:42:54.796567 run osmo-stp_10.42.42.5: Starting osmo-stp 06:42:55.339552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3655): Launched 06:42:55.646642 run osmo-stp_10.42.42.5(pid=3656): Launched 06:42:55.763114 run osmo-msc_10.42.42.6: Starting osmo-msc 06:42:56.314858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3658): Launched 06:42:56.620676 run osmo-msc_10.42.42.6(pid=3659): Launched 06:42:56.791770 run osmo-stp_10.42.42.5(pid=3656): ERR: Terminated: ERROR {rc=1} [trial-2355↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3656)] 06:42:56.922623 run osmo-stp_10.42.42.5(pid=3656): stdout: | (launched: 2022-12-09_06:42:55.590545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:57.053070 run osmo-stp_10.42.42.5(pid=3656): stderr: | 20221209064255761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064255761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064255762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064255762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064255763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064255763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064255763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:57.181145 run osmo-stp_10.42.42.5(pid=3656): stdout: | (launched: 2022-12-09_06:42:55.590545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:42:57.303171 run osmo-stp_10.42.42.5(pid=3656): stderr: | 20221209064255761 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064255761 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064255762 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064255762 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064255763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064255763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064255763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:42:57.448661 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3656): Process ended prematurely: osmo-stp_10.42.42.5(pid=3656) [trial-2355↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3656)] [trial-2355↪encryption↪register_a5_3_authreq.py:8] 06:42:57.457477 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 06:42:57.483509 run osmo-hlr_10.42.42.2(pid=3653): ERR: Terminated: ERROR {rc=237} [trial-2355↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3653)] 06:42:57.531912 run osmo-hlr_10.42.42.2(pid=3653): stdout: | (launched: 2022-12-09_06:42:54.623303) 06:42:57.581734 run osmo-hlr_10.42.42.2(pid=3653): stderr: | 20221209064254802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064254802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064254802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064254802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064254802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064254802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064254814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064254825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064254825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064254825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:42:57.651098 run osmo-msc_10.42.42.6(pid=3659): ERR: Terminated: ERROR {rc=2} [trial-2355↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3659)] 06:42:57.699168 run osmo-msc_10.42.42.6(pid=3659): stdout: | (launched: 2022-12-09_06:42:56.564820) 06:42:57.748862 run osmo-msc_10.42.42.6(pid=3659): stderr: | 20221209064256840 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064256840 DLGLOBAL DEBUG validating counter group 0x7f6433aa5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064256840 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064256840 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064256840 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064256841 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064256843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064256844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064256844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064256844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:42:57.799085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3652): Terminating (SIGTERM) 06:42:57.839126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3655): Terminating (SIGTERM) 06:42:57.879390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3658): Terminating (SIGTERM) 06:42:57.919473 --- ParallelTerminationStrategy: PID 3652 died... 06:42:57.938439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3652): Terminated: ok {rc=0} 06:42:57.982906 --- ParallelTerminationStrategy: PID 3655 died... 06:42:58.001498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3655): Terminated: ok {rc=0} 06:42:58.045834 --- ParallelTerminationStrategy: PID 3658 died... 06:42:58.064379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3658): Terminated: ok {rc=0} 06:42:58.150638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 06:42:59.354313 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:42:59.359034 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 06:42:59.376828 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 06:42:59.404401 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 06:42:59.430688 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 06:42:59.448472 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 06:42:59.474775 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 06:42:59.986864 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 06:42:59.991602 tst handover.py:11: TEST_CONFIG: {} 06:43:00.196519 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:00.212408 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:00.235337 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:00.286598 tst handover.py: using MSISDN 7075 06:43:00.399280 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7075', subscriber_id=0} 06:43:00.505735 run srsepc_10.42.42.118: Starting srsepc 06:43:02.476496 run rm-remote-dir(pid=3664): Launched 06:43:02.609080 bus /sierra_2: Setting Powered False 06:43:03.674848 run rm-remote-dir(pid=3664): Terminated: ok {rc=0} 06:43:04.145334 run mk-remote-dir(pid=3665): Launched 06:43:05.337796 run mk-remote-dir(pid=3665): Terminated: ok {rc=0} 06:43:05.644418 run scp-inst-to-remote(pid=3666): Launched 06:43:07.835386 run scp-inst-to-remote(pid=3666): Terminated: ok {rc=0} 06:43:08.192800 run rm-remote-dir(pid=3668): Launched 06:43:09.384335 run rm-remote-dir(pid=3668): Terminated: ok {rc=0} 06:43:09.743125 run mk-remote-dir(pid=3669): Launched 06:43:10.934890 run mk-remote-dir(pid=3669): Terminated: ok {rc=0} 06:43:11.241266 run scp-cfg-to-remote(pid=3670): Launched 06:43:12.430271 run scp-cfg-to-remote(pid=3670): Terminated: ok {rc=0} 06:43:12.734088 run scp-db-to-remote(pid=3672): Launched 06:43:13.924548 run scp-db-to-remote(pid=3672): Terminated: ok {rc=0} 06:43:14.065161 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:14.395624 run patchelf(pid=3674): Launched 06:43:15.585032 run patchelf(pid=3674): Terminated: ok {rc=0} 06:43:15.725517 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:16.066198 run setcap-netadm(pid=3675): Launched 06:43:17.293095 run setcap-netadm(pid=3675): Terminated: ok {rc=0} 06:43:17.620464 run srsepc(pid=3676): Launched 06:43:17.735282 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:18.835160 run rm-remote-dir(pid=3677): Launched 06:43:19.009926 run srsepc(pid=3676): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3676)] 06:43:19.144230 run srsepc(pid=3676): stdout: | (launched: 2022-12-09_06:43:17.564060) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:19.279133 run srsepc(pid=3676): stderr: | (launched: 2022-12-09_06:43:17.609989) | Connection to 10.42.42.116 closed. 06:43:19.414105 run srsepc(pid=3676): stdout: | (launched: 2022-12-09_06:43:17.564060) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:19.543666 run srsepc(pid=3676): stderr: | (launched: 2022-12-09_06:43:17.609989) | Connection to 10.42.42.116 closed. 06:43:19.696815 run rm-remote-dir(pid=3677): Terminating (SIGINT) 06:43:19.873678 run rm-remote-dir(pid=3677): Terminated: ok {rc=0} 06:43:20.001362 tst handover.py:37: ERR: Error: srsepc(pid=3676): Process ended prematurely: srsepc(pid=3676) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3676)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 06:43:20.011261 tst handover.py:37: Test FAILED (20.0 sec) 06:43:20.088386 run scp-back-log(pid=3678): Launched 06:43:21.165567 run scp-back-log(pid=3678): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3678)] 06:43:21.226684 run scp-back-log(pid=3678): stdout: | (launched: 2022-12-09_06:43:20.058265) 06:43:21.289707 run scp-back-log(pid=3678): stderr: | (launched: 2022-12-09_06:43:20.077994) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:43:21.360370 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3678): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3678)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 06:43:21.405926 tst iperf3_bidir.py:13: Number of physical ue: 1 06:43:21.611253 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:21.653280 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 06:43:21.857749 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:21.873523 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:21.905366 tst iperf3_bidir.py: using MSISDN 7076 06:43:22.025991 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7076', subscriber_id=0} 06:43:22.141477 run srsepc_10.42.42.118: Starting srsepc 06:43:22.814647 run rm-remote-dir(pid=3680): Launched 06:43:24.007313 run rm-remote-dir(pid=3680): Terminated: ok {rc=0} 06:43:24.367078 run mk-remote-dir(pid=3681): Launched 06:43:25.559416 run mk-remote-dir(pid=3681): Terminated: ok {rc=0} 06:43:25.864820 run scp-inst-to-remote(pid=3682): Launched 06:43:28.056429 run scp-inst-to-remote(pid=3682): Terminated: ok {rc=0} 06:43:28.413457 run rm-remote-dir(pid=3684): Launched 06:43:29.605992 run rm-remote-dir(pid=3684): Terminated: ok {rc=0} 06:43:29.964773 run mk-remote-dir(pid=3685): Launched 06:43:31.156670 run mk-remote-dir(pid=3685): Terminated: ok {rc=0} 06:43:31.462335 run scp-cfg-to-remote(pid=3686): Launched 06:43:32.695309 run scp-cfg-to-remote(pid=3686): Terminated: ok {rc=0} 06:43:32.979544 run scp-db-to-remote(pid=3688): Launched 06:43:34.157211 run scp-db-to-remote(pid=3688): Terminated: ok {rc=0} 06:43:34.288859 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:34.612662 run patchelf(pid=3690): Launched 06:43:35.795252 run patchelf(pid=3690): Terminated: ok {rc=0} 06:43:35.929506 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:36.236715 run setcap-netadm(pid=3691): Launched 06:43:37.412590 run setcap-netadm(pid=3691): Terminated: ok {rc=0} 06:43:37.735783 run srsepc(pid=3692): Launched 06:43:37.849014 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:38.994908 run rm-remote-dir(pid=3693): Launched 06:43:39.170212 run srsepc(pid=3692): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3692)] 06:43:39.304734 run srsepc(pid=3692): stdout: | (launched: 2022-12-09_06:43:37.679630) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:39.439652 run srsepc(pid=3692): stderr: | (launched: 2022-12-09_06:43:37.725367) | Connection to 10.42.42.116 closed. 06:43:39.574090 run srsepc(pid=3692): stdout: | (launched: 2022-12-09_06:43:37.679630) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:39.703422 run srsepc(pid=3692): stderr: | (launched: 2022-12-09_06:43:37.725367) | Connection to 10.42.42.116 closed. 06:43:39.856167 run rm-remote-dir(pid=3693): Terminating (SIGINT) 06:43:40.033178 run rm-remote-dir(pid=3693): Terminated: ok {rc=0} 06:43:40.161071 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=3692): Process ended prematurely: srsepc(pid=3692) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3692)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 06:43:40.170836 tst iperf3_bidir.py:42: Test FAILED (18.8 sec) 06:43:40.248605 run scp-back-log(pid=3694): Launched 06:43:41.325531 run scp-back-log(pid=3694): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3694)] 06:43:41.386707 run scp-back-log(pid=3694): stdout: | (launched: 2022-12-09_06:43:40.217998) 06:43:41.448937 run scp-back-log(pid=3694): stderr: | (launched: 2022-12-09_06:43:40.237902) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:43:41.519234 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3694): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3694)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 06:43:41.564802 tst iperf3_dl.py:13: Number of physical ue: 1 06:43:41.770185 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:43:41.815926 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 06:43:42.018964 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:43:42.034625 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:43:42.067425 tst iperf3_dl.py: using MSISDN 7077 06:43:42.178562 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7077', subscriber_id=0} 06:43:42.285643 run srsepc_10.42.42.118: Starting srsepc 06:43:42.909644 run rm-remote-dir(pid=3696): Launched 06:43:44.087374 run rm-remote-dir(pid=3696): Terminated: ok {rc=0} 06:43:44.420845 run mk-remote-dir(pid=3697): Launched 06:43:45.598275 run mk-remote-dir(pid=3697): Terminated: ok {rc=0} 06:43:45.897740 run scp-inst-to-remote(pid=3698): Launched 06:43:48.145296 run scp-inst-to-remote(pid=3698): Terminated: ok {rc=0} 06:43:48.501818 run rm-remote-dir(pid=3700): Launched 06:43:49.693363 run rm-remote-dir(pid=3700): Terminated: ok {rc=0} 06:43:50.050271 run mk-remote-dir(pid=3701): Launched 06:43:51.242086 run mk-remote-dir(pid=3701): Terminated: ok {rc=0} 06:43:51.547806 run scp-cfg-to-remote(pid=3702): Launched 06:43:52.735703 run scp-cfg-to-remote(pid=3702): Terminated: ok {rc=0} 06:43:53.038465 run scp-db-to-remote(pid=3704): Launched 06:43:54.225126 run scp-db-to-remote(pid=3704): Terminated: ok {rc=0} 06:43:54.357103 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:43:54.664182 run patchelf(pid=3706): Launched 06:43:55.840652 run patchelf(pid=3706): Terminated: ok {rc=0} 06:43:55.972430 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:43:56.279003 run setcap-netadm(pid=3707): Launched 06:43:57.455106 run setcap-netadm(pid=3707): Terminated: ok {rc=0} 06:43:57.777333 run srsepc(pid=3708): Launched 06:43:57.890643 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:43:58.995118 run rm-remote-dir(pid=3709): Launched 06:43:59.169689 run srsepc(pid=3708): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3708)] 06:43:59.303554 run srsepc(pid=3708): stdout: | (launched: 2022-12-09_06:43:57.721745) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:59.438656 run srsepc(pid=3708): stderr: | (launched: 2022-12-09_06:43:57.767123) | Connection to 10.42.42.116 closed. 06:43:59.573132 run srsepc(pid=3708): stdout: | (launched: 2022-12-09_06:43:57.721745) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:43:59.702271 run srsepc(pid=3708): stderr: | (launched: 2022-12-09_06:43:57.767123) | Connection to 10.42.42.116 closed. 06:43:59.854872 run rm-remote-dir(pid=3709): Terminating (SIGINT) 06:44:00.031602 run rm-remote-dir(pid=3709): Terminated: ok {rc=0} 06:44:00.159173 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=3708): Process ended prematurely: srsepc(pid=3708) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3708)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 06:44:00.169084 tst iperf3_dl.py:42: Test FAILED (18.6 sec) 06:44:00.246914 run scp-back-log(pid=3710): Launched 06:44:01.323197 run scp-back-log(pid=3710): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3710)] 06:44:01.391015 run scp-back-log(pid=3710): stdout: | (launched: 2022-12-09_06:44:00.216399) 06:44:01.460603 run scp-back-log(pid=3710): stderr: | (launched: 2022-12-09_06:44:00.236389) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:44:01.537849 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3710): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3710)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 06:44:01.589488 tst iperf3_ul.py:13: Number of physical ue: 1 06:44:01.819355 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:44:01.864238 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 06:44:02.071423 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:44:02.087779 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:44:02.120318 tst iperf3_ul.py: using MSISDN 7078 06:44:02.241109 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7078', subscriber_id=0} 06:44:02.356616 run srsepc_10.42.42.118: Starting srsepc 06:44:03.027121 run rm-remote-dir(pid=3712): Launched 06:44:04.218910 run rm-remote-dir(pid=3712): Terminated: ok {rc=0} 06:44:04.577237 run mk-remote-dir(pid=3713): Launched 06:44:05.767502 run mk-remote-dir(pid=3713): Terminated: ok {rc=0} 06:44:06.073190 run scp-inst-to-remote(pid=3714): Launched 06:44:08.259648 run scp-inst-to-remote(pid=3714): Terminated: ok {rc=0} 06:44:08.592814 run rm-remote-dir(pid=3716): Launched 06:44:09.770730 run rm-remote-dir(pid=3716): Terminated: ok {rc=0} 06:44:10.106027 run mk-remote-dir(pid=3718): Launched 06:44:11.283657 run mk-remote-dir(pid=3718): Terminated: ok {rc=0} 06:44:11.570056 run scp-cfg-to-remote(pid=3719): Launched 06:44:12.745735 run scp-cfg-to-remote(pid=3719): Terminated: ok {rc=0} 06:44:13.029456 run scp-db-to-remote(pid=3721): Launched 06:44:14.205423 run scp-db-to-remote(pid=3721): Terminated: ok {rc=0} 06:44:14.336560 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:14.644232 run patchelf(pid=3723): Launched 06:44:15.819532 run patchelf(pid=3723): Terminated: ok {rc=0} 06:44:15.955783 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:16.276557 run setcap-netadm(pid=3724): Launched 06:44:17.455880 run setcap-netadm(pid=3724): Terminated: ok {rc=0} 06:44:17.779567 run srsepc(pid=3725): Launched 06:44:17.892289 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:18.995721 run rm-remote-dir(pid=3726): Launched 06:44:19.170732 run srsepc(pid=3725): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3725)] 06:44:19.304866 run srsepc(pid=3725): stdout: | (launched: 2022-12-09_06:44:17.723430) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:19.439635 run srsepc(pid=3725): stderr: | (launched: 2022-12-09_06:44:17.769128) | Connection to 10.42.42.116 closed. 06:44:19.574236 run srsepc(pid=3725): stdout: | (launched: 2022-12-09_06:44:17.723430) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:19.704403 run srsepc(pid=3725): stderr: | (launched: 2022-12-09_06:44:17.769128) | Connection to 10.42.42.116 closed. 06:44:19.857654 run rm-remote-dir(pid=3726): Terminating (SIGINT) 06:44:20.034155 run rm-remote-dir(pid=3726): Terminated: ok {rc=0} 06:44:20.162081 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=3725): Process ended prematurely: srsepc(pid=3725) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3725)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 06:44:20.171897 tst iperf3_ul.py:42: Test FAILED (18.6 sec) 06:44:20.249250 run scp-back-log(pid=3727): Launched 06:44:21.326924 run scp-back-log(pid=3727): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3727)] 06:44:21.388109 run scp-back-log(pid=3727): stdout: | (launched: 2022-12-09_06:44:20.219130) 06:44:21.450726 run scp-back-log(pid=3727): stderr: | (launched: 2022-12-09_06:44:20.238982) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:44:21.521321 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3727): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3727)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 06:44:21.567163 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:44:21.583867 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:44:21.606940 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:44:21.655361 tst ping.py: using MSISDN 7079 06:44:21.769946 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7079', subscriber_id=0} 06:44:21.876809 run srsepc_10.42.42.118: Starting srsepc 06:44:22.502752 run rm-remote-dir(pid=3729): Launched 06:44:23.679902 run rm-remote-dir(pid=3729): Terminated: ok {rc=0} 06:44:24.014176 run mk-remote-dir(pid=3730): Launched 06:44:25.190536 run mk-remote-dir(pid=3730): Terminated: ok {rc=0} 06:44:25.475022 run scp-inst-to-remote(pid=3731): Launched 06:44:27.652605 run scp-inst-to-remote(pid=3731): Terminated: ok {rc=0} 06:44:27.984820 run rm-remote-dir(pid=3733): Launched 06:44:29.162032 run rm-remote-dir(pid=3733): Terminated: ok {rc=0} 06:44:29.495833 run mk-remote-dir(pid=3734): Launched 06:44:30.673227 run mk-remote-dir(pid=3734): Terminated: ok {rc=0} 06:44:30.965654 run scp-cfg-to-remote(pid=3735): Launched 06:44:32.195620 run scp-cfg-to-remote(pid=3735): Terminated: ok {rc=0} 06:44:32.497590 run scp-db-to-remote(pid=3737): Launched 06:44:33.673423 run scp-db-to-remote(pid=3737): Terminated: ok {rc=0} 06:44:33.804756 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:34.111067 run patchelf(pid=3739): Launched 06:44:35.286558 run patchelf(pid=3739): Terminated: ok {rc=0} 06:44:35.417605 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:35.723258 run setcap-netadm(pid=3740): Launched 06:44:36.898067 run setcap-netadm(pid=3740): Terminated: ok {rc=0} 06:44:37.219731 run srsepc(pid=3741): Launched 06:44:37.332584 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:38.510673 run rm-remote-dir(pid=3742): Launched 06:44:38.700416 run srsepc(pid=3741): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3741)] 06:44:38.845644 run srsepc(pid=3741): stdout: | (launched: 2022-12-09_06:44:37.163623) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:38.989773 run srsepc(pid=3741): stderr: | (launched: 2022-12-09_06:44:37.209258) | Connection to 10.42.42.116 closed. 06:44:39.134105 run srsepc(pid=3741): stdout: | (launched: 2022-12-09_06:44:37.163623) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:39.273326 run srsepc(pid=3741): stderr: | (launched: 2022-12-09_06:44:37.209258) | Connection to 10.42.42.116 closed. 06:44:39.439151 run rm-remote-dir(pid=3742): Terminating (SIGINT) 06:44:39.628361 run rm-remote-dir(pid=3742): Terminated: ok {rc=0} 06:44:39.765693 tst ping.py:16: ERR: Error: srsepc(pid=3741): Process ended prematurely: srsepc(pid=3741) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3741)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 06:44:39.776402 tst ping.py:16: Test FAILED (18.2 sec) 06:44:39.857149 run scp-back-log(pid=3743): Launched 06:44:40.936872 run scp-back-log(pid=3743): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3743)] 06:44:41.000470 run scp-back-log(pid=3743): stdout: | (launched: 2022-12-09_06:44:39.825490) 06:44:41.065732 run scp-back-log(pid=3743): stderr: | (launched: 2022-12-09_06:44:39.846312) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:44:41.139177 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3743): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3743)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 06:44:41.186820 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:44:41.203696 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:44:41.227167 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:44:41.277836 tst rrc_idle_mo_ping.py: using MSISDN 7080 06:44:41.398879 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7080', subscriber_id=0} 06:44:41.513041 run srsepc_10.42.42.118: Starting srsepc 06:44:42.182095 run rm-remote-dir(pid=3745): Launched 06:44:43.373199 run rm-remote-dir(pid=3745): Terminated: ok {rc=0} 06:44:43.730795 run mk-remote-dir(pid=3746): Launched 06:44:44.922160 run mk-remote-dir(pid=3746): Terminated: ok {rc=0} 06:44:45.228069 run scp-inst-to-remote(pid=3747): Launched 06:44:47.423658 run scp-inst-to-remote(pid=3747): Terminated: ok {rc=0} 06:44:47.818579 run rm-remote-dir(pid=3749): Launched 06:44:49.010860 run rm-remote-dir(pid=3749): Terminated: ok {rc=0} 06:44:49.369211 run mk-remote-dir(pid=3750): Launched 06:44:50.560115 run mk-remote-dir(pid=3750): Terminated: ok {rc=0} 06:44:50.865055 run scp-cfg-to-remote(pid=3751): Launched 06:44:52.053584 run scp-cfg-to-remote(pid=3751): Terminated: ok {rc=0} 06:44:52.357238 run scp-db-to-remote(pid=3753): Launched 06:44:53.549816 run scp-db-to-remote(pid=3753): Terminated: ok {rc=0} 06:44:53.689598 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:44:54.018822 run patchelf(pid=3755): Launched 06:44:55.208343 run patchelf(pid=3755): Terminated: ok {rc=0} 06:44:55.349649 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:44:55.679121 run setcap-netadm(pid=3756): Launched 06:44:56.867394 run setcap-netadm(pid=3756): Terminated: ok {rc=0} 06:44:57.213410 run srsepc(pid=3757): Launched 06:44:57.336543 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:44:58.450456 run rm-remote-dir(pid=3758): Launched 06:44:58.624717 run srsepc(pid=3757): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3757)] 06:44:58.758084 run srsepc(pid=3757): stdout: | (launched: 2022-12-09_06:44:57.153751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:58.892775 run srsepc(pid=3757): stderr: | (launched: 2022-12-09_06:44:57.202678) | Connection to 10.42.42.116 closed. 06:44:59.027493 run srsepc(pid=3757): stdout: | (launched: 2022-12-09_06:44:57.153751) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:44:59.156316 run srsepc(pid=3757): stderr: | (launched: 2022-12-09_06:44:57.202678) | Connection to 10.42.42.116 closed. 06:44:59.309214 run rm-remote-dir(pid=3758): Terminating (SIGINT) 06:44:59.485677 run rm-remote-dir(pid=3758): Terminated: ok {rc=0} 06:44:59.613389 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=3757): Process ended prematurely: srsepc(pid=3757) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3757)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 06:44:59.623216 tst rrc_idle_mo_ping.py:16: Test FAILED (18.4 sec) 06:44:59.700870 run scp-back-log(pid=3759): Launched 06:45:00.777442 run scp-back-log(pid=3759): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3759)] 06:45:00.854198 run scp-back-log(pid=3759): stdout: | (launched: 2022-12-09_06:44:59.670473) 06:45:00.941291 run scp-back-log(pid=3759): stderr: | (launched: 2022-12-09_06:44:59.690476) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:45:01.027132 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3759): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3759)]') ---------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 06:45:01.093352 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 06:45:01.110430 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 06:45:01.135380 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 06:45:01.184005 tst rrc_idle_mt_ping.py: using MSISDN 7081 06:45:01.308820 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7081', subscriber_id=0} 06:45:01.431162 run srsepc_10.42.42.118: Starting srsepc 06:45:02.177073 run rm-remote-dir(pid=3764): Launched 06:45:03.436833 run rm-remote-dir(pid=3764): Terminated: ok {rc=0} 06:45:03.772354 run mk-remote-dir(pid=3765): Launched 06:45:04.949511 run mk-remote-dir(pid=3765): Terminated: ok {rc=0} 06:45:05.235773 run scp-inst-to-remote(pid=3766): Launched 06:45:07.417566 run scp-inst-to-remote(pid=3766): Terminated: ok {rc=0} 06:45:07.774260 run rm-remote-dir(pid=3768): Launched 06:45:08.965628 run rm-remote-dir(pid=3768): Terminated: ok {rc=0} 06:45:09.323848 run mk-remote-dir(pid=3769): Launched 06:45:10.515467 run mk-remote-dir(pid=3769): Terminated: ok {rc=0} 06:45:10.820348 run scp-cfg-to-remote(pid=3770): Launched 06:45:12.009792 run scp-cfg-to-remote(pid=3770): Terminated: ok {rc=0} 06:45:12.313455 run scp-db-to-remote(pid=3772): Launched 06:45:13.502240 run scp-db-to-remote(pid=3772): Terminated: ok {rc=0} 06:45:13.642095 run srsepc_10.42.42.118: Setting RPATH for srsepc 06:45:13.971712 run patchelf(pid=3774): Launched 06:45:15.161196 run patchelf(pid=3774): Terminated: ok {rc=0} 06:45:15.302254 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 06:45:15.632289 run setcap-netadm(pid=3775): Launched 06:45:16.836759 run setcap-netadm(pid=3775): Terminated: ok {rc=0} 06:45:17.213666 run srsepc(pid=3776): Launched 06:45:17.363634 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 06:45:18.550067 run rm-remote-dir(pid=3777): Launched 06:45:18.739477 run srsepc(pid=3776): ERR: Terminated: ERROR {rc=127} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3776)] 06:45:18.883844 run srsepc(pid=3776): stdout: | (launched: 2022-12-09_06:45:17.142939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:19.027879 run srsepc(pid=3776): stderr: | (launched: 2022-12-09_06:45:17.192611) | Connection to 10.42.42.116 closed. 06:45:19.171866 run srsepc(pid=3776): stdout: | (launched: 2022-12-09_06:45:17.142939) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 06:45:19.310896 run srsepc(pid=3776): stderr: | (launched: 2022-12-09_06:45:17.192611) | Connection to 10.42.42.116 closed. 06:45:19.475668 run rm-remote-dir(pid=3777): Terminating (SIGINT) 06:45:19.665206 run rm-remote-dir(pid=3777): Terminated: ok {rc=0} 06:45:19.802322 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=3776): Process ended prematurely: srsepc(pid=3776) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3776)] [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 06:45:19.812639 tst rrc_idle_mt_ping.py:16: Test FAILED (18.7 sec) 06:45:19.893240 run scp-back-log(pid=3778): Launched 06:45:20.974062 run scp-back-log(pid=3778): ERR: Terminated: ERROR {rc=1} [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3778)] 06:45:21.038362 run scp-back-log(pid=3778): stdout: | (launched: 2022-12-09_06:45:19.861696) 06:45:21.104045 run scp-back-log(pid=3778): stderr: | (launched: 2022-12-09_06:45:19.882567) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 06:45:21.178153 tst srsepc_10.42.42.118: Error('scp-back-log(pid=3778): launch_sync(): local process exited with status 1 [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=3778)]') --------------------------------------------------------------------- trial-2355 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 06:45:21.309888 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:21.315252 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 06:45:21.357286 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 06:45:21.384323 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 06:45:21.437916 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 06:45:21.480909 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 06:45:21.507144 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 06:45:22.057542 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 06:45:22.063864 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:22.075483 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:45:22.113332 tst handover.py: using LAC 19648 06:45:22.240874 tst handover.py: using RAC 13 06:45:22.368307 tst handover.py: using CellId 19648 06:45:22.496017 tst handover.py: using BVCI 19649 06:45:22.608211 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 06:45:22.648388 tst handover.py: using LAC 19649 06:45:22.768042 tst handover.py: using RAC 14 06:45:22.885860 tst handover.py: using CellId 19649 06:45:23.002665 tst handover.py: using BVCI 19650 06:45:23.113769 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:23.124549 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:23.135307 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:23.146059 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:23.156800 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 06:45:23.167631 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:45:23.285743 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 06:45:23.406343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:23.906941 run create_hlr_db(pid=3786): Launched 06:45:25.087662 run create_hlr_db(pid=3786): Terminated: ok {rc=0} 06:45:25.430746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3788): Launched 06:45:25.753276 run osmo-hlr_10.42.42.2(pid=3789): Launched 06:45:25.875397 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:26.434913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3791): Launched 06:45:26.757872 run osmo-stp_10.42.42.5(pid=3792): Launched 06:45:26.880327 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:27.465414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3794): Launched 06:45:27.788303 run osmo-msc_10.42.42.6(pid=3795): Launched 06:45:27.967277 run osmo-stp_10.42.42.5(pid=3792): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3792)] 06:45:28.103401 run osmo-stp_10.42.42.5(pid=3792): stdout: | (launched: 2022-12-09_06:45:26.699227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:28.240033 run osmo-stp_10.42.42.5(pid=3792): stderr: | 20221209064526891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064526891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064526892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064526893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064526893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064526893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064526893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:28.376729 run osmo-stp_10.42.42.5(pid=3792): stdout: | (launched: 2022-12-09_06:45:26.699227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:28.504872 run osmo-stp_10.42.42.5(pid=3792): stderr: | 20221209064526891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064526891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064526892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064526893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064526893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064526893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064526893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:28.658144 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3792): Process ended prematurely: osmo-stp_10.42.42.5(pid=3792) [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3792)] [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 06:45:28.666856 tst handover.py:18: Test FAILED (6.6 sec) 06:45:28.694239 run osmo-hlr_10.42.42.2(pid=3789): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3789)] 06:45:28.744412 run osmo-hlr_10.42.42.2(pid=3789): stdout: | (launched: 2022-12-09_06:45:25.694929) 06:45:28.796408 run osmo-hlr_10.42.42.2(pid=3789): stderr: | 20221209064525892 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064525892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064525892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064525892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064525892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064525892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064525904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064525912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064525912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064525912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:28.869240 run osmo-msc_10.42.42.6(pid=3795): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3795)] 06:45:28.919498 run osmo-msc_10.42.42.6(pid=3795): stdout: | (launched: 2022-12-09_06:45:27.729770) 06:45:28.971403 run osmo-msc_10.42.42.6(pid=3795): stderr: | 20221209064528051 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064528052 DLGLOBAL DEBUG validating counter group 0x7fd1e65ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064528052 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064528052 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064528052 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064528052 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064528054 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064528054 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064528054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064528054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:29.023837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3788): Terminating (SIGTERM) 06:45:29.065851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3791): Terminating (SIGTERM) 06:45:29.108024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3794): Terminating (SIGTERM) 06:45:29.150420 --- ParallelTerminationStrategy: PID 3788 died... 06:45:29.170003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3788): Terminated: ok {rc=0} 06:45:29.216401 --- ParallelTerminationStrategy: PID 3791 died... 06:45:29.236031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3791): Terminated: ok {rc=0} 06:45:29.282348 --- ParallelTerminationStrategy: PID 3794 died... 06:45:29.301950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3794): Terminated: ok {rc=0} 06:45:29.390995 bus /sierra_3: Setting Powered False 06:45:30.490927 bus /sierra_3: Setting Powered False 06:45:31.623763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 06:45:32.889461 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:32.894904 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:45:32.935276 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:45:32.962493 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:45:33.019140 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:45:33.059888 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:45:33.086939 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:45:33.636878 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 06:45:33.642287 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:33.653486 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:45:33.691098 tst handover.py: using LAC 19650 06:45:33.817296 tst handover.py: using RAC 15 06:45:33.941881 tst handover.py: using CellId 19650 06:45:34.066602 tst handover.py: using BVCI 19651 06:45:34.183580 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 06:45:34.216755 tst handover.py: using LAC 19651 06:45:34.341713 tst handover.py: using RAC 16 06:45:34.468555 tst handover.py: using CellId 19651 06:45:34.594528 tst handover.py: using BVCI 19652 06:45:34.713448 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:34.724578 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:34.735642 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:34.746688 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:34.757786 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:45:34.768715 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:45:34.884155 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 06:45:35.003767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:35.478147 run create_hlr_db(pid=3801): Launched 06:45:35.600497 bus /sierra_2: Setting Powered False 06:45:36.664713 run create_hlr_db(pid=3801): Terminated: ok {rc=0} 06:45:37.086657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3803): Launched 06:45:37.411216 run osmo-hlr_10.42.42.2(pid=3804): Launched 06:45:37.535135 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:38.067464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3806): Launched 06:45:38.392647 run osmo-stp_10.42.42.5(pid=3807): Launched 06:45:38.516810 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:39.074615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3809): Launched 06:45:39.399833 run osmo-msc_10.42.42.6(pid=3810): Launched 06:45:39.580445 run osmo-stp_10.42.42.5(pid=3807): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3807)] 06:45:39.717527 run osmo-stp_10.42.42.5(pid=3807): stdout: | (launched: 2022-12-09_06:45:38.333793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:39.855395 run osmo-stp_10.42.42.5(pid=3807): stderr: | 20221209064538525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064538525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064538526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064538526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064538528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064538528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064538528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:39.993760 run osmo-stp_10.42.42.5(pid=3807): stdout: | (launched: 2022-12-09_06:45:38.333793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:40.122984 run osmo-stp_10.42.42.5(pid=3807): stderr: | 20221209064538525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064538525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064538526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064538526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064538528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064538528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064538528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:40.277787 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3807): Process ended prematurely: osmo-stp_10.42.42.5(pid=3807) [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3807)] [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 06:45:40.286383 tst handover.py:18: Test FAILED (6.6 sec) 06:45:40.314612 run osmo-hlr_10.42.42.2(pid=3804): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3804)] 06:45:40.365114 run osmo-hlr_10.42.42.2(pid=3804): stdout: | (launched: 2022-12-09_06:45:37.352485) 06:45:40.417072 run osmo-hlr_10.42.42.2(pid=3804): stderr: | 20221209064537551 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064537551 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064537551 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064537551 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064537551 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064537551 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064537562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064537571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064537571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064537571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:40.489432 run osmo-msc_10.42.42.6(pid=3810): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3810)] 06:45:40.539870 run osmo-msc_10.42.42.6(pid=3810): stdout: | (launched: 2022-12-09_06:45:39.340513) 06:45:40.591968 run osmo-msc_10.42.42.6(pid=3810): stderr: | 20221209064539663 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064539663 DLGLOBAL DEBUG validating counter group 0x7ff422992c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064539663 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064539663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064539664 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064539664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064539666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064539666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064539666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064539666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:40.644402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3803): Terminating (SIGTERM) 06:45:40.686114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3806): Terminating (SIGTERM) 06:45:40.728076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3809): Terminating (SIGTERM) 06:45:40.770437 --- ParallelTerminationStrategy: PID 3803 died... 06:45:40.790353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3803): Terminated: ok {rc=0} 06:45:40.836715 --- ParallelTerminationStrategy: PID 3806 died... 06:45:40.856178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3806): Terminated: ok {rc=0} 06:45:40.902584 --- ParallelTerminationStrategy: PID 3809 died... 06:45:40.922015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3809): Terminated: ok {rc=0} 06:45:41.010154 bus /sierra_3: Setting Powered False 06:45:42.106948 bus /sierra_3: Setting Powered False 06:45:43.221993 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 06:45:44.464688 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:44.469867 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:45:44.522285 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:45:44.548781 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:45:44.603775 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:45:44.659045 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:45:44.685899 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:45:45.230330 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 06:45:45.237201 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:45.248440 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:45:45.288449 tst handover.py: using LAC 19652 06:45:45.415989 tst handover.py: using RAC 17 06:45:45.542509 tst handover.py: using CellId 19652 06:45:45.670643 tst handover.py: using BVCI 19653 06:45:45.787857 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:45:45.842749 tst handover.py: using LAC 19653 06:45:45.982439 tst handover.py: using RAC 18 06:45:46.116776 tst handover.py: using CellId 19653 06:45:46.245494 tst handover.py: using BVCI 19654 06:45:46.364062 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:46.375741 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:46.387338 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:46.398764 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:46.410321 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:45:46.421500 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:45:46.538845 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:45:46.672543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:47.161034 run create_hlr_db(pid=3815): Launched 06:45:47.302330 bus /sierra_2: Setting Powered False 06:45:48.367393 run create_hlr_db(pid=3815): Terminated: ok {rc=0} 06:45:48.791896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3817): Launched 06:45:49.116303 run osmo-hlr_10.42.42.2(pid=3818): Launched 06:45:49.239519 run osmo-stp_10.42.42.5: Starting osmo-stp 06:45:49.769716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3820): Launched 06:45:50.093556 run osmo-stp_10.42.42.5(pid=3821): Launched 06:45:50.216646 run osmo-msc_10.42.42.6: Starting osmo-msc 06:45:50.774859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3823): Launched 06:45:51.099558 run osmo-msc_10.42.42.6(pid=3824): Launched 06:45:51.279973 run osmo-stp_10.42.42.5(pid=3821): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3821)] 06:45:51.417192 run osmo-stp_10.42.42.5(pid=3821): stdout: | (launched: 2022-12-09_06:45:50.034821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:51.554627 run osmo-stp_10.42.42.5(pid=3821): stderr: | 20221209064550228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064550229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064550230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064550230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064550231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064550231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064550231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:51.690910 run osmo-stp_10.42.42.5(pid=3821): stdout: | (launched: 2022-12-09_06:45:50.034821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:45:51.819953 run osmo-stp_10.42.42.5(pid=3821): stderr: | 20221209064550228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064550229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064550230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064550230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064550231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064550231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064550231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:45:51.974260 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3821): Process ended prematurely: osmo-stp_10.42.42.5(pid=3821) [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3821)] [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 06:45:51.983044 tst handover.py:18: Test FAILED (6.7 sec) 06:45:52.011070 run osmo-hlr_10.42.42.2(pid=3818): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3818)] 06:45:52.061819 run osmo-hlr_10.42.42.2(pid=3818): stdout: | (launched: 2022-12-09_06:45:49.057587) 06:45:52.113653 run osmo-hlr_10.42.42.2(pid=3818): stderr: | 20221209064549257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064549257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064549257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064549257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064549257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064549258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064549270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064549280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064549281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064549281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:45:52.185981 run osmo-msc_10.42.42.6(pid=3824): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3824)] 06:45:52.236087 run osmo-msc_10.42.42.6(pid=3824): stdout: | (launched: 2022-12-09_06:45:51.040628) 06:45:52.287984 run osmo-msc_10.42.42.6(pid=3824): stderr: | 20221209064551359 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064551360 DLGLOBAL DEBUG validating counter group 0x7fc954bf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064551360 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064551360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064551360 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064551361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064551362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064551363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064551363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064551363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:45:52.340854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3817): Terminating (SIGTERM) 06:45:52.383338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3820): Terminating (SIGTERM) 06:45:52.425425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3823): Terminating (SIGTERM) 06:45:52.467887 --- ParallelTerminationStrategy: PID 3817 died... 06:45:52.487865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3817): Terminated: ok {rc=0} 06:45:52.534652 --- ParallelTerminationStrategy: PID 3820 died... 06:45:52.554312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3820): Terminated: ok {rc=0} 06:45:52.601093 --- ParallelTerminationStrategy: PID 3823 died... 06:45:52.620630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3823): Terminated: ok {rc=0} 06:45:52.709238 bus /sierra_3: Setting Powered False 06:45:53.808841 bus /sierra_3: Setting Powered False 06:45:54.925002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:45:56.188057 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:45:56.193821 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:45:56.244778 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:45:56.272015 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:45:56.324844 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:45:56.376003 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:45:56.403446 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:45:56.955970 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:45:56.962262 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:56.973487 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:45:57.012192 tst handover.py: using LAC 19654 06:45:57.130573 tst handover.py: using RAC 19 06:45:57.250353 tst handover.py: using CellId 19654 06:45:57.370125 tst handover.py: using BVCI 19655 06:45:57.488820 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:45:57.535596 tst handover.py: using LAC 19655 06:45:57.663003 tst handover.py: using RAC 20 06:45:57.789574 tst handover.py: using CellId 19655 06:45:57.908764 tst handover.py: using BVCI 19656 06:45:58.018903 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:58.030420 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:58.041403 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:58.052330 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:58.063351 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:45:58.074240 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:45:58.189951 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:45:58.304288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:45:58.747232 run create_hlr_db(pid=3829): Launched 06:45:58.869652 bus /sierra_2: Setting Powered False 06:45:59.930213 run create_hlr_db(pid=3829): Terminated: ok {rc=0} 06:46:00.345524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3831): Launched 06:46:00.671540 run osmo-hlr_10.42.42.2(pid=3832): Launched 06:46:00.794865 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:01.460382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3834): Launched 06:46:01.813726 run osmo-stp_10.42.42.5(pid=3835): Launched 06:46:02.027078 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:02.745242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3837): Launched 06:46:03.069612 run osmo-msc_10.42.42.6(pid=3838): Launched 06:46:03.251052 run osmo-stp_10.42.42.5(pid=3835): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3835)] 06:46:03.390161 run osmo-stp_10.42.42.5(pid=3835): stdout: | (launched: 2022-12-09_06:46:01.743411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:03.528248 run osmo-stp_10.42.42.5(pid=3835): stderr: | 20221209064602059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064602059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064602060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064602061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064602061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064602061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064602061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:03.658639 run osmo-stp_10.42.42.5(pid=3835): stdout: | (launched: 2022-12-09_06:46:01.743411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:03.779311 run osmo-stp_10.42.42.5(pid=3835): stderr: | 20221209064602059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064602059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064602060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064602061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064602061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064602061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064602061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:03.923300 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3835): Process ended prematurely: osmo-stp_10.42.42.5(pid=3835) [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3835)] [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 06:46:03.931797 tst handover.py:18: Test FAILED (7.0 sec) 06:46:03.958174 run osmo-hlr_10.42.42.2(pid=3832): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3832)] 06:46:04.006873 run osmo-hlr_10.42.42.2(pid=3832): stdout: | (launched: 2022-12-09_06:46:00.612616) 06:46:04.056923 run osmo-hlr_10.42.42.2(pid=3832): stderr: | 20221209064600812 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064600812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064600812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064600812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064600812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064600812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064600826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064600835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064600835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064600835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:04.126801 run osmo-msc_10.42.42.6(pid=3838): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3838)] 06:46:04.175148 run osmo-msc_10.42.42.6(pid=3838): stdout: | (launched: 2022-12-09_06:46:03.010862) 06:46:04.225163 run osmo-msc_10.42.42.6(pid=3838): stderr: | 20221209064603329 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064603329 DLGLOBAL DEBUG validating counter group 0x7f54c7bfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064603329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064603330 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064603330 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064603330 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064603331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064603332 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064603332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064603332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:04.275191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3831): Terminating (SIGTERM) 06:46:04.315285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3834): Terminating (SIGTERM) 06:46:04.355511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3837): Terminating (SIGTERM) 06:46:04.396610 --- ParallelTerminationStrategy: PID 3831 died... 06:46:04.415695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3831): Terminated: ok {rc=0} 06:46:04.461441 --- ParallelTerminationStrategy: PID 3834 died... 06:46:04.480494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3834): Terminated: ok {rc=0} 06:46:04.525486 --- ParallelTerminationStrategy: PID 3837 died... 06:46:04.544549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3837): Terminated: ok {rc=0} 06:46:04.632215 bus /sierra_3: Setting Powered False 06:46:05.733187 bus /sierra_3: Setting Powered False 06:46:06.846629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:46:08.104341 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:08.110107 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:46:08.165859 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:46:08.193281 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:46:08.246765 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:46:08.303053 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:46:08.330729 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:46:08.881596 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:46:08.887057 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:08.898547 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:46:08.938169 tst handover.py: using LAC 19656 06:46:09.064084 tst handover.py: using RAC 21 06:46:09.192290 tst handover.py: using CellId 19656 06:46:09.320452 tst handover.py: using BVCI 19657 06:46:09.438165 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:46:09.488665 tst handover.py: using LAC 19657 06:46:09.619873 tst handover.py: using RAC 22 06:46:09.740249 tst handover.py: using CellId 19657 06:46:09.858760 tst handover.py: using BVCI 19658 06:46:09.970449 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:09.981597 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:09.992557 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:10.004178 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:10.015825 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:46:10.027386 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:46:10.146357 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:46:10.266002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:10.739960 run create_hlr_db(pid=3843): Launched 06:46:10.862867 bus /sierra_2: Setting Powered False 06:46:11.926237 run create_hlr_db(pid=3843): Terminated: ok {rc=0} 06:46:12.348033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3845): Launched 06:46:12.671618 run osmo-hlr_10.42.42.2(pid=3846): Launched 06:46:12.795567 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:13.325573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3848): Launched 06:46:13.648833 run osmo-stp_10.42.42.5(pid=3849): Launched 06:46:13.771454 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:14.326512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3851): Launched 06:46:14.649335 run osmo-msc_10.42.42.6(pid=3852): Launched 06:46:14.829870 run osmo-stp_10.42.42.5(pid=3849): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3849)] 06:46:14.966909 run osmo-stp_10.42.42.5(pid=3849): stdout: | (launched: 2022-12-09_06:46:13.590351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:15.104936 run osmo-stp_10.42.42.5(pid=3849): stderr: | 20221209064613782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064613782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064613782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064613783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064613783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064613783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064613783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:15.241501 run osmo-stp_10.42.42.5(pid=3849): stdout: | (launched: 2022-12-09_06:46:13.590351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:15.370875 run osmo-stp_10.42.42.5(pid=3849): stderr: | 20221209064613782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064613782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064613782 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064613783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064613783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064613783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064613783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:15.525029 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3849): Process ended prematurely: osmo-stp_10.42.42.5(pid=3849) [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3849)] [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 06:46:15.533957 tst handover.py:18: Test FAILED (6.6 sec) 06:46:15.561748 run osmo-hlr_10.42.42.2(pid=3846): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3846)] 06:46:15.612611 run osmo-hlr_10.42.42.2(pid=3846): stdout: | (launched: 2022-12-09_06:46:12.612601) 06:46:15.664867 run osmo-hlr_10.42.42.2(pid=3846): stderr: | 20221209064612809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064612809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064612809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064612809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064612809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064612809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064612822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064612831 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064612832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064612832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:15.737731 run osmo-msc_10.42.42.6(pid=3852): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3852)] 06:46:15.788224 run osmo-msc_10.42.42.6(pid=3852): stdout: | (launched: 2022-12-09_06:46:14.590914) 06:46:15.840711 run osmo-msc_10.42.42.6(pid=3852): stderr: | 20221209064614912 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064614913 DLGLOBAL DEBUG validating counter group 0x7fcf01b06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064614913 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064614913 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064614913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064614913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064614915 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064614915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064614915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064614915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:15.894142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3845): Terminating (SIGTERM) 06:46:15.937150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3848): Terminating (SIGTERM) 06:46:15.980138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3851): Terminating (SIGTERM) 06:46:16.023797 --- ParallelTerminationStrategy: PID 3845 died... 06:46:16.044028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3845): Terminated: ok {rc=0} 06:46:16.092029 --- ParallelTerminationStrategy: PID 3848 died... 06:46:16.112293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3848): Terminated: ok {rc=0} 06:46:16.160285 --- ParallelTerminationStrategy: PID 3851 died... 06:46:16.180659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3851): Terminated: ok {rc=0} 06:46:16.275947 bus /sierra_3: Setting Powered False 06:46:17.377998 bus /sierra_3: Setting Powered False 06:46:18.493999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 06:46:19.763543 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:19.769851 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:46:19.811741 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:46:19.838138 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:46:19.889309 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:46:19.930256 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:46:19.956590 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:46:20.506864 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 06:46:20.513563 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:20.524875 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:46:20.563591 tst handover.py: using LAC 19658 06:46:20.690222 tst handover.py: using RAC 23 06:46:20.816354 tst handover.py: using CellId 19658 06:46:20.935462 tst handover.py: using BVCI 19659 06:46:21.046368 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 06:46:21.084819 tst handover.py: using LAC 19659 06:46:21.202255 tst handover.py: using RAC 24 06:46:21.318580 tst handover.py: using CellId 19659 06:46:21.435003 tst handover.py: using BVCI 19660 06:46:21.544259 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:21.555047 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:21.565655 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:21.576390 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:21.587199 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:46:21.597934 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:46:21.711152 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 06:46:21.826789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:22.267794 run create_hlr_db(pid=3857): Launched 06:46:22.390007 bus /sierra_2: Setting Powered False 06:46:23.449803 run create_hlr_db(pid=3857): Terminated: ok {rc=0} 06:46:23.862777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Launched 06:46:24.185174 run osmo-hlr_10.42.42.2(pid=3860): Launched 06:46:24.307851 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:24.837220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Launched 06:46:25.160097 run osmo-stp_10.42.42.5(pid=3863): Launched 06:46:25.283222 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:25.840204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Launched 06:46:26.164246 run osmo-msc_10.42.42.6(pid=3866): Launched 06:46:26.344772 run osmo-stp_10.42.42.5(pid=3863): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] 06:46:26.481733 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-09_06:46:25.101660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:26.619514 run osmo-stp_10.42.42.5(pid=3863): stderr: | 20221209064625292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064625292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064625292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064625293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064625295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064625295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064625295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:26.755938 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-09_06:46:25.101660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:26.884861 run osmo-stp_10.42.42.5(pid=3863): stderr: | 20221209064625292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064625292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064625292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064625293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064625295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064625295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064625295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:27.039273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 06:46:27.048246 tst handover.py:18: Test FAILED (6.5 sec) 06:46:27.076278 run osmo-hlr_10.42.42.2(pid=3860): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3860)] 06:46:27.126767 run osmo-hlr_10.42.42.2(pid=3860): stdout: | (launched: 2022-12-09_06:46:24.127069) 06:46:27.178896 run osmo-hlr_10.42.42.2(pid=3860): stderr: | 20221209064624325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064624325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064624325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064624325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064624325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064624326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064624336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064624344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064624344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064624344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:27.251478 run osmo-msc_10.42.42.6(pid=3866): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3866)] 06:46:27.301825 run osmo-msc_10.42.42.6(pid=3866): stdout: | (launched: 2022-12-09_06:46:26.105363) 06:46:27.354310 run osmo-msc_10.42.42.6(pid=3866): stderr: | 20221209064626426 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064626426 DLGLOBAL DEBUG validating counter group 0x7f714b3a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064626426 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064626426 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064626426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064626427 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064626428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064626429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064626429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064626429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:27.406892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminating (SIGTERM) 06:46:27.449185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminating (SIGTERM) 06:46:27.491595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Terminating (SIGTERM) 06:46:27.534315 --- ParallelTerminationStrategy: PID 3859 died... 06:46:27.554356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminated: ok {rc=0} 06:46:27.601324 --- ParallelTerminationStrategy: PID 3862 died... 06:46:27.621007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminated: ok {rc=0} 06:46:27.667805 --- ParallelTerminationStrategy: PID 3865 died... 06:46:27.687355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3865): Terminated: ok {rc=0} 06:46:27.775166 bus /sierra_3: Setting Powered False 06:46:28.875539 bus /sierra_3: Setting Powered False 06:46:29.992117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 06:46:31.269895 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:31.277528 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:46:31.333252 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:46:31.360770 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:46:31.412008 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:46:31.484770 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:46:31.522367 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:46:32.082837 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 06:46:32.090238 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:32.102897 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:46:32.146788 tst handover.py: using LAC 19660 06:46:32.283993 tst handover.py: using RAC 25 06:46:32.411338 tst handover.py: using CellId 19660 06:46:32.537385 tst handover.py: using BVCI 19661 06:46:32.655354 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:46:32.704031 tst handover.py: using LAC 19661 06:46:32.829802 tst handover.py: using RAC 26 06:46:32.947308 tst handover.py: using CellId 19661 06:46:33.064378 tst handover.py: using BVCI 19662 06:46:33.173523 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:33.184375 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:33.195190 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:33.205993 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:33.216738 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:46:33.227552 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:46:33.345988 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:46:33.461287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:33.904044 run create_hlr_db(pid=3871): Launched 06:46:34.027522 bus /sierra_2: Setting Powered False 06:46:35.088630 run create_hlr_db(pid=3871): Terminated: ok {rc=0} 06:46:35.503304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3873): Launched 06:46:35.827812 run osmo-hlr_10.42.42.2(pid=3874): Launched 06:46:35.951082 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:36.484001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3876): Launched 06:46:36.807505 run osmo-stp_10.42.42.5(pid=3877): Launched 06:46:36.926919 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:37.447364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3879): Launched 06:46:37.748164 run osmo-msc_10.42.42.6(pid=3880): Launched 06:46:37.916353 run osmo-stp_10.42.42.5(pid=3877): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3877)] 06:46:38.044199 run osmo-stp_10.42.42.5(pid=3877): stdout: | (launched: 2022-12-09_06:46:36.748879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:38.172084 run osmo-stp_10.42.42.5(pid=3877): stderr: | 20221209064636919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064636919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064636919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064636920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064636922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064636922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064636922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:38.297956 run osmo-stp_10.42.42.5(pid=3877): stdout: | (launched: 2022-12-09_06:46:36.748879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:38.417806 run osmo-stp_10.42.42.5(pid=3877): stderr: | 20221209064636919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064636919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064636919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064636920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064636922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064636922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064636922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:38.561170 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3877): Process ended prematurely: osmo-stp_10.42.42.5(pid=3877) [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3877)] [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 06:46:38.569329 tst handover.py:18: Test FAILED (6.5 sec) 06:46:38.595323 run osmo-hlr_10.42.42.2(pid=3874): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3874)] 06:46:38.644412 run osmo-hlr_10.42.42.2(pid=3874): stdout: | (launched: 2022-12-09_06:46:35.769501) 06:46:38.694150 run osmo-hlr_10.42.42.2(pid=3874): stderr: | 20221209064635968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064635968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064635968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064635968 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064635968 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064635968 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064635980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064635988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064635988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064635988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:38.763883 run osmo-msc_10.42.42.6(pid=3880): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3880)] 06:46:38.811688 run osmo-msc_10.42.42.6(pid=3880): stdout: | (launched: 2022-12-09_06:46:37.693489) 06:46:38.861149 run osmo-msc_10.42.42.6(pid=3880): stderr: | 20221209064637963 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064637964 DLGLOBAL DEBUG validating counter group 0x7f5be66f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064637964 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064637964 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064637964 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064637964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064637966 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064637966 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064637966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064637966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:38.910810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3873): Terminating (SIGTERM) 06:46:38.950684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3876): Terminating (SIGTERM) 06:46:38.990573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3879): Terminating (SIGTERM) 06:46:39.030648 --- ParallelTerminationStrategy: PID 3873 died... 06:46:39.049910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3873): Terminated: ok {rc=0} 06:46:39.094200 --- ParallelTerminationStrategy: PID 3876 died... 06:46:39.112767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3876): Terminated: ok {rc=0} 06:46:39.157196 --- ParallelTerminationStrategy: PID 3879 died... 06:46:39.175893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3879): Terminated: ok {rc=0} 06:46:39.259738 bus /sierra_3: Setting Powered False 06:46:40.358585 bus /sierra_3: Setting Powered False 06:46:41.477666 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 06:46:42.738777 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:42.743911 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:46:42.796379 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:46:42.822733 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:46:42.874644 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:46:42.926563 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:46:42.952655 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:46:43.503305 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 06:46:43.508325 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:43.519161 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:46:43.556389 tst handover.py: using LAC 19662 06:46:43.674567 tst handover.py: using RAC 27 06:46:43.793590 tst handover.py: using CellId 19662 06:46:43.922856 tst handover.py: using BVCI 19663 06:46:44.040274 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:46:44.089736 tst handover.py: using LAC 19663 06:46:44.218141 tst handover.py: using RAC 28 06:46:44.345527 tst handover.py: using CellId 19663 06:46:44.465301 tst handover.py: using BVCI 19664 06:46:44.574560 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:44.585338 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:44.595838 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:44.606901 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:44.618122 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:46:44.629260 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:46:44.749652 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:46:44.871562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:45.344911 run create_hlr_db(pid=3885): Launched 06:46:45.470337 bus /sierra_2: Setting Powered False 06:46:46.552124 run create_hlr_db(pid=3885): Terminated: ok {rc=0} 06:46:46.962251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Launched 06:46:47.284384 run osmo-hlr_10.42.42.2(pid=3888): Launched 06:46:47.399849 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:47.916236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Launched 06:46:48.216300 run osmo-stp_10.42.42.5(pid=3891): Launched 06:46:48.330609 run osmo-msc_10.42.42.6: Starting osmo-msc 06:46:48.849351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Launched 06:46:49.151289 run osmo-msc_10.42.42.6(pid=3894): Launched 06:46:49.318539 run osmo-stp_10.42.42.5(pid=3891): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] 06:46:49.445861 run osmo-stp_10.42.42.5(pid=3891): stdout: | (launched: 2022-12-09_06:46:48.161684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:49.573413 run osmo-stp_10.42.42.5(pid=3891): stderr: | 20221209064648331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064648331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064648331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064648332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064648332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064648332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064648333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:49.698951 run osmo-stp_10.42.42.5(pid=3891): stdout: | (launched: 2022-12-09_06:46:48.161684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:46:49.818332 run osmo-stp_10.42.42.5(pid=3891): stderr: | 20221209064648331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064648331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064648331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064648332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064648332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064648332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064648333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:46:49.961511 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3891): Process ended prematurely: osmo-stp_10.42.42.5(pid=3891) [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 06:46:49.969430 tst handover.py:18: Test FAILED (6.5 sec) 06:46:49.995237 run osmo-hlr_10.42.42.2(pid=3888): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3888)] 06:46:50.042788 run osmo-hlr_10.42.42.2(pid=3888): stdout: | (launched: 2022-12-09_06:46:47.222019) 06:46:50.092157 run osmo-hlr_10.42.42.2(pid=3888): stderr: | 20221209064647409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064647409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064647409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064647409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064647409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064647409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064647421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064647429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064647429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064647429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:46:50.160802 run osmo-msc_10.42.42.6(pid=3894): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3894)] 06:46:50.208319 run osmo-msc_10.42.42.6(pid=3894): stdout: | (launched: 2022-12-09_06:46:49.095813) 06:46:50.257536 run osmo-msc_10.42.42.6(pid=3894): stderr: | 20221209064649366 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064649367 DLGLOBAL DEBUG validating counter group 0x7f1cbe065c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064649367 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064649367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064649367 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064649367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064649370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064649370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064649371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064649371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:46:50.307227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Terminating (SIGTERM) 06:46:50.346860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Terminating (SIGTERM) 06:46:50.386502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Terminating (SIGTERM) 06:46:50.426382 --- ParallelTerminationStrategy: PID 3887 died... 06:46:50.445347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3887): Terminated: ok {rc=0} 06:46:50.489307 --- ParallelTerminationStrategy: PID 3890 died... 06:46:50.507724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3890): Terminated: ok {rc=0} 06:46:50.552027 --- ParallelTerminationStrategy: PID 3893 died... 06:46:50.570637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3893): Terminated: ok {rc=0} 06:46:50.653764 bus /sierra_3: Setting Powered False 06:46:51.752066 bus /sierra_3: Setting Powered False 06:46:52.867356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 06:46:54.126542 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:46:54.131981 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 06:46:54.170517 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 06:46:54.197949 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 06:46:54.251623 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 06:46:54.290525 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 06:46:54.318043 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 06:46:54.865900 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 06:46:54.871472 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:54.882779 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:46:54.917638 tst handover.py: using LAC 19664 06:46:55.047246 tst handover.py: using RAC 29 06:46:55.165524 tst handover.py: using CellId 19664 06:46:55.283208 tst handover.py: using BVCI 19665 06:46:55.394052 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 06:46:55.430996 tst handover.py: using LAC 19665 06:46:55.557361 tst handover.py: using RAC 30 06:46:55.681348 tst handover.py: using CellId 19665 06:46:55.805589 tst handover.py: using BVCI 19666 06:46:55.922554 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:55.933782 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:55.944752 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:55.956115 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:55.967453 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 06:46:55.978878 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:46:56.094490 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 06:46:56.216873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:46:56.691689 run create_hlr_db(pid=3899): Launched 06:46:56.814907 bus /sierra_2: Setting Powered False 06:46:57.878544 run create_hlr_db(pid=3899): Terminated: ok {rc=0} 06:46:58.301690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Launched 06:46:58.626490 run osmo-hlr_10.42.42.2(pid=3902): Launched 06:46:58.749528 run osmo-stp_10.42.42.5: Starting osmo-stp 06:46:59.283076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Launched 06:46:59.607557 run osmo-stp_10.42.42.5(pid=3905): Launched 06:46:59.731477 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:00.290190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Launched 06:47:00.615542 run osmo-msc_10.42.42.6(pid=3908): Launched 06:47:00.796073 run osmo-stp_10.42.42.5(pid=3905): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] 06:47:01.041872 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-09_06:46:59.548889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:01.252485 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221209064659740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064659741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064659741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064659741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064659743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064659744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064659744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:01.442709 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-09_06:46:59.548889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:01.568570 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221209064659740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064659741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064659741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064659741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064659743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064659744 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064659744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:01.719093 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3905): Process ended prematurely: osmo-stp_10.42.42.5(pid=3905) [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 06:47:01.728038 tst handover.py:18: Test FAILED (6.8 sec) 06:47:01.755049 run osmo-hlr_10.42.42.2(pid=3902): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3902)] 06:47:01.804521 run osmo-hlr_10.42.42.2(pid=3902): stdout: | (launched: 2022-12-09_06:46:58.567815) 06:47:01.859000 run osmo-hlr_10.42.42.2(pid=3902): stderr: | 20221209064658767 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064658767 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064658767 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064658767 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064658767 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064658767 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064658780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064658789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064658789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064658789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:01.930355 run osmo-msc_10.42.42.6(pid=3908): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3908)] 06:47:01.980383 run osmo-msc_10.42.42.6(pid=3908): stdout: | (launched: 2022-12-09_06:47:00.556569) 06:47:02.031339 run osmo-msc_10.42.42.6(pid=3908): stderr: | 20221209064700881 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064700882 DLGLOBAL DEBUG validating counter group 0x7fb96a384c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064700882 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064700882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064700882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064700882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064700884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064700884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064700884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064700884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:02.084103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminating (SIGTERM) 06:47:02.125789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminating (SIGTERM) 06:47:02.169168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminating (SIGTERM) 06:47:02.213226 --- ParallelTerminationStrategy: PID 3901 died... 06:47:02.233173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminated: ok {rc=0} 06:47:02.281420 --- ParallelTerminationStrategy: PID 3904 died... 06:47:02.300636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminated: ok {rc=0} 06:47:02.346791 --- ParallelTerminationStrategy: PID 3907 died... 06:47:02.366022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminated: ok {rc=0} 06:47:02.471630 bus /sierra_3: Setting Powered False 06:47:03.569951 bus /sierra_3: Setting Powered False 06:47:04.688730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 06:47:05.930847 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:05.936491 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:47:05.988282 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:47:06.015667 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:47:06.068734 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:47:06.120141 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:47:06.147353 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:47:06.698778 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 06:47:06.704505 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:06.715836 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:06.756438 tst handover.py: using LAC 19666 06:47:06.883021 tst handover.py: using RAC 31 06:47:07.009176 tst handover.py: using CellId 19666 06:47:07.133384 tst handover.py: using BVCI 19667 06:47:07.250385 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:47:07.298219 tst handover.py: using LAC 19667 06:47:07.423536 tst handover.py: using RAC 32 06:47:07.542565 tst handover.py: using CellId 19667 06:47:07.662486 tst handover.py: using BVCI 19668 06:47:07.773945 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:07.784775 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:07.795613 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:07.806647 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:07.817697 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:47:07.828393 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:07.946666 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:47:08.065518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:08.540688 run create_hlr_db(pid=3913): Launched 06:47:08.665926 bus /sierra_2: Setting Powered False 06:47:09.730126 run create_hlr_db(pid=3913): Terminated: ok {rc=0} 06:47:10.153324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Launched 06:47:10.478569 run osmo-hlr_10.42.42.2(pid=3916): Launched 06:47:10.604410 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:11.133933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Launched 06:47:11.457955 run osmo-stp_10.42.42.5(pid=3919): Launched 06:47:11.581485 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:12.138116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3921): Launched 06:47:12.461865 run osmo-msc_10.42.42.6(pid=3922): Launched 06:47:12.641854 run osmo-stp_10.42.42.5(pid=3919): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] 06:47:12.780076 run osmo-stp_10.42.42.5(pid=3919): stdout: | (launched: 2022-12-09_06:47:11.399058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:12.918685 run osmo-stp_10.42.42.5(pid=3919): stderr: | 20221209064711589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064711589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064711590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064711590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064711591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064711591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064711591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:13.055357 run osmo-stp_10.42.42.5(pid=3919): stdout: | (launched: 2022-12-09_06:47:11.399058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:13.184156 run osmo-stp_10.42.42.5(pid=3919): stderr: | 20221209064711589 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064711589 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064711590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064711590 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064711591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064711591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064711591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:13.338626 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3919): Process ended prematurely: osmo-stp_10.42.42.5(pid=3919) [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 06:47:13.347428 tst handover.py:18: Test FAILED (6.6 sec) 06:47:13.375242 run osmo-hlr_10.42.42.2(pid=3916): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3916)] 06:47:13.426227 run osmo-hlr_10.42.42.2(pid=3916): stdout: | (launched: 2022-12-09_06:47:10.419864) 06:47:13.478776 run osmo-hlr_10.42.42.2(pid=3916): stderr: | 20221209064710617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064710617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064710617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064710617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064710617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064710617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064710630 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064710641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064710641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064710641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:13.551881 run osmo-msc_10.42.42.6(pid=3922): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3922)] 06:47:13.602378 run osmo-msc_10.42.42.6(pid=3922): stdout: | (launched: 2022-12-09_06:47:12.402892) 06:47:13.654847 run osmo-msc_10.42.42.6(pid=3922): stderr: | 20221209064712722 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064712722 DLGLOBAL DEBUG validating counter group 0x7f894ed4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064712722 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064712722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064712723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064712723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064712724 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064712725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064712725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064712725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:13.707658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Terminating (SIGTERM) 06:47:13.749927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Terminating (SIGTERM) 06:47:13.792117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3921): Terminating (SIGTERM) 06:47:13.834595 --- ParallelTerminationStrategy: PID 3915 died... 06:47:13.854418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3915): Terminated: ok {rc=0} 06:47:13.901270 --- ParallelTerminationStrategy: PID 3918 died... 06:47:13.920576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3918): Terminated: ok {rc=0} 06:47:13.967209 --- ParallelTerminationStrategy: PID 3921 died... 06:47:13.986758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3921): Terminated: ok {rc=0} 06:47:14.074843 bus /sierra_3: Setting Powered False 06:47:15.170159 bus /sierra_3: Setting Powered False 06:47:16.295466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:47:17.555717 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:17.560657 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:47:17.606900 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:47:17.633222 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:47:17.685243 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:47:17.731678 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:47:17.758079 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:47:18.308277 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:47:18.313778 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:18.324691 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:18.358575 tst handover.py: using LAC 19668 06:47:18.477639 tst handover.py: using RAC 33 06:47:18.600696 tst handover.py: using CellId 19668 06:47:18.721646 tst handover.py: using BVCI 19669 06:47:18.831934 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:47:18.877893 tst handover.py: using LAC 19669 06:47:19.006443 tst handover.py: using RAC 34 06:47:19.134908 tst handover.py: using CellId 19669 06:47:19.262912 tst handover.py: using BVCI 19670 06:47:19.382927 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:19.394589 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:19.406194 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:19.417821 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:19.429398 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:47:19.440812 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:19.556207 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:47:19.677270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:20.121606 run create_hlr_db(pid=3927): Launched 06:47:20.246265 bus /sierra_2: Setting Powered False 06:47:21.306257 run create_hlr_db(pid=3927): Terminated: ok {rc=0} 06:47:21.724077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3929): Launched 06:47:22.050085 run osmo-hlr_10.42.42.2(pid=3930): Launched 06:47:22.173684 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:22.708419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3932): Launched 06:47:23.032515 run osmo-stp_10.42.42.5(pid=3933): Launched 06:47:23.156054 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:23.714266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3935): Launched 06:47:24.038571 run osmo-msc_10.42.42.6(pid=3936): Launched 06:47:24.219218 run osmo-stp_10.42.42.5(pid=3933): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3933)] 06:47:24.356712 run osmo-stp_10.42.42.5(pid=3933): stdout: | (launched: 2022-12-09_06:47:22.973784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:24.494860 run osmo-stp_10.42.42.5(pid=3933): stderr: | 20221209064723167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064723167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064723168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064723168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064723168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064723169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064723169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:24.631586 run osmo-stp_10.42.42.5(pid=3933): stdout: | (launched: 2022-12-09_06:47:22.973784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:24.760666 run osmo-stp_10.42.42.5(pid=3933): stderr: | 20221209064723167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064723167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064723168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064723168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064723168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064723169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064723169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:24.915240 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3933): Process ended prematurely: osmo-stp_10.42.42.5(pid=3933) [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3933)] [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 06:47:24.924109 tst handover.py:18: Test FAILED (6.6 sec) 06:47:24.952134 run osmo-hlr_10.42.42.2(pid=3930): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3930)] 06:47:25.002749 run osmo-hlr_10.42.42.2(pid=3930): stdout: | (launched: 2022-12-09_06:47:21.990657) 06:47:25.055263 run osmo-hlr_10.42.42.2(pid=3930): stderr: | 20221209064722188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064722188 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064722188 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064722188 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064722188 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064722188 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064722200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064722209 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064722209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064722209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:25.128094 run osmo-msc_10.42.42.6(pid=3936): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3936)] 06:47:25.178659 run osmo-msc_10.42.42.6(pid=3936): stdout: | (launched: 2022-12-09_06:47:23.979719) 06:47:25.230875 run osmo-msc_10.42.42.6(pid=3936): stderr: | 20221209064724299 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064724299 DLGLOBAL DEBUG validating counter group 0x7f8a31bd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064724299 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064724299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064724300 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064724300 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064724301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064724302 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064724302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064724302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:25.284001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3929): Terminating (SIGTERM) 06:47:25.326201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3932): Terminating (SIGTERM) 06:47:25.368791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3935): Terminating (SIGTERM) 06:47:25.411515 --- ParallelTerminationStrategy: PID 3929 died... 06:47:25.431653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3929): Terminated: ok {rc=0} 06:47:25.478952 --- ParallelTerminationStrategy: PID 3932 died... 06:47:25.498521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3932): Terminated: ok {rc=0} 06:47:25.545306 --- ParallelTerminationStrategy: PID 3935 died... 06:47:25.564848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3935): Terminated: ok {rc=0} 06:47:25.653217 bus /sierra_3: Setting Powered False 06:47:26.751890 bus /sierra_3: Setting Powered False 06:47:27.867210 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:47:29.122403 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:29.127437 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:47:29.177830 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:47:29.204228 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:47:29.254732 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:47:29.304866 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:47:29.331100 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:47:29.883014 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:47:29.888438 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:29.899459 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:29.933426 tst handover.py: using LAC 19670 06:47:30.053972 tst handover.py: using RAC 35 06:47:30.172919 tst handover.py: using CellId 19670 06:47:30.292934 tst handover.py: using BVCI 19671 06:47:30.402207 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:47:30.450663 tst handover.py: using LAC 19671 06:47:30.570746 tst handover.py: using RAC 36 06:47:30.689213 tst handover.py: using CellId 19671 06:47:30.816335 tst handover.py: using BVCI 19672 06:47:30.959203 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:30.970903 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:30.982291 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:30.994387 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:31.007575 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:47:31.022371 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:31.146722 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:47:31.299543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:31.837985 run create_hlr_db(pid=3941): Launched 06:47:32.029447 bus /sierra_2: Setting Powered False 06:47:33.093359 run create_hlr_db(pid=3941): Terminated: ok {rc=0} 06:47:33.517640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3943): Launched 06:47:33.841731 run osmo-hlr_10.42.42.2(pid=3944): Launched 06:47:33.965394 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:34.498114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3946): Launched 06:47:34.822462 run osmo-stp_10.42.42.5(pid=3947): Launched 06:47:34.945963 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:35.506009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3949): Launched 06:47:35.832329 run osmo-msc_10.42.42.6(pid=3951): Launched 06:47:36.004535 run osmo-stp_10.42.42.5(pid=3947): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3947)] 06:47:36.183737 run osmo-stp_10.42.42.5(pid=3947): stdout: | (launched: 2022-12-09_06:47:34.763848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:36.310698 run osmo-stp_10.42.42.5(pid=3947): stderr: | 20221209064734957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064734957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064734957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064734958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064734958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064734958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064734958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:36.437167 run osmo-stp_10.42.42.5(pid=3947): stdout: | (launched: 2022-12-09_06:47:34.763848) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:36.557966 run osmo-stp_10.42.42.5(pid=3947): stderr: | 20221209064734957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064734957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064734957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064734958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064734958 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064734958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064734958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:36.702093 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3947): Process ended prematurely: osmo-stp_10.42.42.5(pid=3947) [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3947)] [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 06:47:36.710286 tst handover.py:18: Test FAILED (6.8 sec) 06:47:36.736174 run osmo-hlr_10.42.42.2(pid=3944): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3944)] 06:47:36.784316 run osmo-hlr_10.42.42.2(pid=3944): stdout: | (launched: 2022-12-09_06:47:33.783345) 06:47:36.833974 run osmo-hlr_10.42.42.2(pid=3944): stderr: | 20221209064733983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064733983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064733983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064733983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064733983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064733983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064733996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064734006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064734006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064734006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:36.903030 run osmo-msc_10.42.42.6(pid=3951): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3951)] 06:47:36.950917 run osmo-msc_10.42.42.6(pid=3951): stdout: | (launched: 2022-12-09_06:47:35.772105) 06:47:37.000421 run osmo-msc_10.42.42.6(pid=3951): stderr: | 20221209064736044 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064736045 DLGLOBAL DEBUG validating counter group 0x7f1336a18c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064736045 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064736045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064736045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064736045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064736047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064736047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064736047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064736048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:37.050411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3943): Terminating (SIGTERM) 06:47:37.090279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3946): Terminating (SIGTERM) 06:47:37.130128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3949): Terminating (SIGTERM) 06:47:37.170611 --- ParallelTerminationStrategy: PID 3943 died... 06:47:37.189863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3943): Terminated: ok {rc=0} 06:47:37.233845 --- ParallelTerminationStrategy: PID 3946 died... 06:47:37.252225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3946): Terminated: ok {rc=0} 06:47:37.296134 --- ParallelTerminationStrategy: PID 3949 died... 06:47:37.314782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3949): Terminated: ok {rc=0} 06:47:37.400832 bus /sierra_3: Setting Powered False 06:47:38.501698 bus /sierra_3: Setting Powered False 06:47:39.617756 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 06:47:40.878281 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:40.884167 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:47:40.923980 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:47:40.951388 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:47:41.003621 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:47:41.043043 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:47:41.070577 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:47:41.621701 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 06:47:41.627020 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:41.638218 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:47:41.679830 tst handover.py: using LAC 19672 06:47:41.798483 tst handover.py: using RAC 37 06:47:41.925704 tst handover.py: using CellId 19672 06:47:42.043682 tst handover.py: using BVCI 19673 06:47:42.155095 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 06:47:42.187938 tst handover.py: using LAC 19673 06:47:42.306183 tst handover.py: using RAC 38 06:47:42.423784 tst handover.py: using CellId 19673 06:47:42.546738 tst handover.py: using BVCI 19674 06:47:42.658583 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:42.669355 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:42.680064 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:42.691357 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:42.702405 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:47:42.713659 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:47:42.833375 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 06:47:42.949503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:43.395140 run create_hlr_db(pid=3956): Launched 06:47:43.517992 bus /sierra_2: Setting Powered False 06:47:44.577988 run create_hlr_db(pid=3956): Terminated: ok {rc=0} 06:47:44.993732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Launched 06:47:45.317509 run osmo-hlr_10.42.42.2(pid=3959): Launched 06:47:45.441774 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:46.003241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Launched 06:47:46.333731 run osmo-stp_10.42.42.5(pid=3962): Launched 06:47:46.482319 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:47.138875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Launched 06:47:47.456198 run osmo-msc_10.42.42.6(pid=3965): Launched 06:47:47.623873 run osmo-stp_10.42.42.5(pid=3962): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] 06:47:47.750509 run osmo-stp_10.42.42.5(pid=3962): stdout: | (launched: 2022-12-09_06:47:46.266215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:47.878272 run osmo-stp_10.42.42.5(pid=3962): stderr: | 20221209064746604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064746604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064746604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064746604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064746605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064746605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064746605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:48.004234 run osmo-stp_10.42.42.5(pid=3962): stdout: | (launched: 2022-12-09_06:47:46.266215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:48.123974 run osmo-stp_10.42.42.5(pid=3962): stderr: | 20221209064746604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064746604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064746604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064746604 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064746605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064746605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064746605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:48.267381 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3962): Process ended prematurely: osmo-stp_10.42.42.5(pid=3962) [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 06:47:48.275537 tst handover.py:18: Test FAILED (6.6 sec) 06:47:48.301681 run osmo-hlr_10.42.42.2(pid=3959): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3959)] 06:47:48.349348 run osmo-hlr_10.42.42.2(pid=3959): stdout: | (launched: 2022-12-09_06:47:45.259175) 06:47:48.398964 run osmo-hlr_10.42.42.2(pid=3959): stderr: | 20221209064745457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064745457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064745457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064745457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064745457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064745457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064745470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064745480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064745481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064745481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:47:48.468177 run osmo-msc_10.42.42.6(pid=3965): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3965)] 06:47:48.515933 run osmo-msc_10.42.42.6(pid=3965): stdout: | (launched: 2022-12-09_06:47:47.400858) 06:47:48.565357 run osmo-msc_10.42.42.6(pid=3965): stderr: | 20221209064747676 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064747676 DLGLOBAL DEBUG validating counter group 0x7f561482ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064747676 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064747676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064747676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064747677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064747678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064747679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064747679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064747679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:47:48.615031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Terminating (SIGTERM) 06:47:48.654597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Terminating (SIGTERM) 06:47:48.694233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Terminating (SIGTERM) 06:47:48.733966 --- ParallelTerminationStrategy: PID 3958 died... 06:47:48.752867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Terminated: ok {rc=0} 06:47:48.796819 --- ParallelTerminationStrategy: PID 3961 died... 06:47:48.815553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Terminated: ok {rc=0} 06:47:48.859730 --- ParallelTerminationStrategy: PID 3964 died... 06:47:48.878326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Terminated: ok {rc=0} 06:47:48.963780 bus /sierra_3: Setting Powered False 06:47:50.063841 bus /sierra_3: Setting Powered False 06:47:51.176480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 06:47:52.419856 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:47:52.425476 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:47:52.477671 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:47:52.505132 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:47:52.558696 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:47:52.611541 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:47:52.639010 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:47:53.190050 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 06:47:53.195549 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:53.206820 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:47:53.242456 tst handover.py: using LAC 19674 06:47:53.368802 tst handover.py: using RAC 39 06:47:53.492490 tst handover.py: using CellId 19674 06:47:53.610288 tst handover.py: using BVCI 19675 06:47:53.721563 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:47:53.768497 tst handover.py: using LAC 19675 06:47:53.887927 tst handover.py: using RAC 40 06:47:54.005048 tst handover.py: using CellId 19675 06:47:54.122260 tst handover.py: using BVCI 19676 06:47:54.233534 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:54.244469 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:54.255426 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:54.266593 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:54.277842 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:47:54.289120 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:47:54.409515 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:47:54.524851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:47:54.998768 run create_hlr_db(pid=3970): Launched 06:47:55.121923 bus /sierra_2: Setting Powered False 06:47:56.185321 run create_hlr_db(pid=3970): Terminated: ok {rc=0} 06:47:56.608387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Launched 06:47:56.931864 run osmo-hlr_10.42.42.2(pid=3973): Launched 06:47:57.055566 run osmo-stp_10.42.42.5: Starting osmo-stp 06:47:57.588419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Launched 06:47:57.911840 run osmo-stp_10.42.42.5(pid=3976): Launched 06:47:58.035509 run osmo-msc_10.42.42.6: Starting osmo-msc 06:47:58.593501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Launched 06:47:58.917854 run osmo-msc_10.42.42.6(pid=3979): Launched 06:47:59.098427 run osmo-stp_10.42.42.5(pid=3976): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] 06:47:59.235671 run osmo-stp_10.42.42.5(pid=3976): stdout: | (launched: 2022-12-09_06:47:57.853152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:59.373364 run osmo-stp_10.42.42.5(pid=3976): stderr: | 20221209064758043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064758043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064758043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064758044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064758044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064758044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064758044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:59.510380 run osmo-stp_10.42.42.5(pid=3976): stdout: | (launched: 2022-12-09_06:47:57.853152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:47:59.639588 run osmo-stp_10.42.42.5(pid=3976): stderr: | 20221209064758043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064758043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064758043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064758044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064758044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064758044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064758044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:47:59.794008 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3976): Process ended prematurely: osmo-stp_10.42.42.5(pid=3976) [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 06:47:59.802855 tst handover.py:18: Test FAILED (6.6 sec) 06:47:59.830844 run osmo-hlr_10.42.42.2(pid=3973): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3973)] 06:47:59.880889 run osmo-hlr_10.42.42.2(pid=3973): stdout: | (launched: 2022-12-09_06:47:56.873431) 06:47:59.932907 run osmo-hlr_10.42.42.2(pid=3973): stderr: | 20221209064757074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064757074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064757074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064757074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064757074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064757074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064757086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064757095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064757095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064757095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:00.005517 run osmo-msc_10.42.42.6(pid=3979): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3979)] 06:48:00.055619 run osmo-msc_10.42.42.6(pid=3979): stdout: | (launched: 2022-12-09_06:47:58.859081) 06:48:00.107708 run osmo-msc_10.42.42.6(pid=3979): stderr: | 20221209064759179 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064759179 DLGLOBAL DEBUG validating counter group 0x7f87631a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064759179 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064759179 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064759180 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064759180 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064759181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064759182 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064759182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064759182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:00.160177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Terminating (SIGTERM) 06:48:00.202077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Terminating (SIGTERM) 06:48:00.244307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Terminating (SIGTERM) 06:48:00.286834 --- ParallelTerminationStrategy: PID 3972 died... 06:48:00.306668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3972): Terminated: ok {rc=0} 06:48:00.353083 --- ParallelTerminationStrategy: PID 3975 died... 06:48:00.372311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3975): Terminated: ok {rc=0} 06:48:00.418935 --- ParallelTerminationStrategy: PID 3978 died... 06:48:00.438436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3978): Terminated: ok {rc=0} 06:48:00.525231 bus /sierra_3: Setting Powered False 06:48:01.635008 bus /sierra_3: Setting Powered False 06:48:02.767859 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 06:48:04.021211 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:04.026367 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:48:04.075381 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:48:04.101694 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:48:04.152225 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:48:04.201395 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:48:04.227561 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:48:04.778161 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 06:48:04.783256 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:04.794011 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:04.827112 tst handover.py: using LAC 19676 06:48:04.944906 tst handover.py: using RAC 41 06:48:05.062487 tst handover.py: using CellId 19676 06:48:05.181333 tst handover.py: using BVCI 19677 06:48:05.289604 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:48:05.336753 tst handover.py: using LAC 19677 06:48:05.455134 tst handover.py: using RAC 42 06:48:05.573379 tst handover.py: using CellId 19677 06:48:05.691022 tst handover.py: using BVCI 19678 06:48:05.809889 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:05.821128 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:05.832205 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:05.843493 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:05.854907 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:48:05.866286 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:05.982186 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:48:06.100215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:06.573262 run create_hlr_db(pid=3984): Launched 06:48:06.697107 bus /sierra_2: Setting Powered False 06:48:07.761180 run create_hlr_db(pid=3984): Terminated: ok {rc=0} 06:48:08.184336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3986): Launched 06:48:08.509009 run osmo-hlr_10.42.42.2(pid=3987): Launched 06:48:08.633400 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:09.161297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3989): Launched 06:48:09.485531 run osmo-stp_10.42.42.5(pid=3990): Launched 06:48:09.609344 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:10.167263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3992): Launched 06:48:10.474694 run osmo-msc_10.42.42.6(pid=3993): Launched 06:48:10.647837 run osmo-stp_10.42.42.5(pid=3990): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3990)] 06:48:10.777134 run osmo-stp_10.42.42.5(pid=3990): stdout: | (launched: 2022-12-09_06:48:09.426673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:10.905710 run osmo-stp_10.42.42.5(pid=3990): stderr: | 20221209064809620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064809620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064809620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064809621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064809621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064809621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064809622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:11.031667 run osmo-stp_10.42.42.5(pid=3990): stdout: | (launched: 2022-12-09_06:48:09.426673) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:11.151921 run osmo-stp_10.42.42.5(pid=3990): stderr: | 20221209064809620 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064809620 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064809620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064809621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064809621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064809621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064809622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:11.295340 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3990): Process ended prematurely: osmo-stp_10.42.42.5(pid=3990) [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3990)] [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 06:48:11.303553 tst handover.py:18: Test FAILED (6.5 sec) 06:48:11.329548 run osmo-hlr_10.42.42.2(pid=3987): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3987)] 06:48:11.377151 run osmo-hlr_10.42.42.2(pid=3987): stdout: | (launched: 2022-12-09_06:48:08.450325) 06:48:11.426408 run osmo-hlr_10.42.42.2(pid=3987): stderr: | 20221209064808650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064808650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064808650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064808650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064808650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064808650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064808663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064808673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064808673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064808673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:11.496171 run osmo-msc_10.42.42.6(pid=3993): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3993)] 06:48:11.543812 run osmo-msc_10.42.42.6(pid=3993): stdout: | (launched: 2022-12-09_06:48:10.419253) 06:48:11.593134 run osmo-msc_10.42.42.6(pid=3993): stderr: | 20221209064810688 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064810688 DLGLOBAL DEBUG validating counter group 0x7f8aa32b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064810688 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064810688 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064810689 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064810689 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064810691 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064810691 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064810691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064810691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:11.642841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3986): Terminating (SIGTERM) 06:48:11.682617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3989): Terminating (SIGTERM) 06:48:11.722760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3992): Terminating (SIGTERM) 06:48:11.762821 --- ParallelTerminationStrategy: PID 3986 died... 06:48:11.781841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3986): Terminated: ok {rc=0} 06:48:11.825688 --- ParallelTerminationStrategy: PID 3989 died... 06:48:11.844026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3989): Terminated: ok {rc=0} 06:48:11.887961 --- ParallelTerminationStrategy: PID 3992 died... 06:48:11.906453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3992): Terminated: ok {rc=0} 06:48:11.991939 bus /sierra_3: Setting Powered False 06:48:13.091114 bus /sierra_3: Setting Powered False 06:48:14.206413 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 06:48:15.460924 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:15.466900 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 06:48:15.517543 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 06:48:15.545034 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 06:48:15.599801 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 06:48:15.650842 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 06:48:15.678213 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 06:48:16.224025 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 06:48:16.231516 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:16.243470 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:48:16.282504 tst handover.py: using LAC 19678 06:48:16.406201 tst handover.py: using RAC 43 06:48:16.528666 tst handover.py: using CellId 19678 06:48:16.656395 tst handover.py: using BVCI 19679 06:48:16.778701 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 06:48:16.828076 tst handover.py: using LAC 19679 06:48:16.950238 tst handover.py: using RAC 44 06:48:17.074374 tst handover.py: using CellId 19679 06:48:17.194508 tst handover.py: using BVCI 19680 06:48:17.311471 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:17.322847 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:17.333950 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:17.345328 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:17.356394 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 06:48:17.367701 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:48:17.486188 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 06:48:17.600303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:18.042961 run create_hlr_db(pid=3998): Launched 06:48:18.166112 bus /sierra_2: Setting Powered False 06:48:19.226537 run create_hlr_db(pid=3998): Terminated: ok {rc=0} 06:48:19.641216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4000): Launched 06:48:19.965205 run osmo-hlr_10.42.42.2(pid=4001): Launched 06:48:20.088777 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:20.619603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4003): Launched 06:48:20.941736 run osmo-stp_10.42.42.5(pid=4004): Launched 06:48:21.065757 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:21.626011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4006): Launched 06:48:21.950047 run osmo-msc_10.42.42.6(pid=4007): Launched 06:48:22.130399 run osmo-stp_10.42.42.5(pid=4004): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4004)] 06:48:22.267421 run osmo-stp_10.42.42.5(pid=4004): stdout: | (launched: 2022-12-09_06:48:20.883411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:22.406322 run osmo-stp_10.42.42.5(pid=4004): stderr: | 20221209064821079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064821079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064821079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064821080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064821080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064821080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064821080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:22.543699 run osmo-stp_10.42.42.5(pid=4004): stdout: | (launched: 2022-12-09_06:48:20.883411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:22.672943 run osmo-stp_10.42.42.5(pid=4004): stderr: | 20221209064821079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064821079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064821079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064821080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064821080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064821080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064821080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:22.827834 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4004): Process ended prematurely: osmo-stp_10.42.42.5(pid=4004) [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4004)] [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 06:48:22.836781 tst handover.py:18: Test FAILED (6.6 sec) 06:48:22.865045 run osmo-hlr_10.42.42.2(pid=4001): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4001)] 06:48:22.915608 run osmo-hlr_10.42.42.2(pid=4001): stdout: | (launched: 2022-12-09_06:48:19.906758) 06:48:22.968103 run osmo-hlr_10.42.42.2(pid=4001): stderr: | 20221209064820104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064820104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064820104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064820104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064820104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064820104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064820116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064820125 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064820125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064820125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:23.040833 run osmo-msc_10.42.42.6(pid=4007): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4007)] 06:48:23.091409 run osmo-msc_10.42.42.6(pid=4007): stdout: | (launched: 2022-12-09_06:48:21.891258) 06:48:23.143408 run osmo-msc_10.42.42.6(pid=4007): stderr: | 20221209064822211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064822211 DLGLOBAL DEBUG validating counter group 0x7f0829f45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064822211 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064822211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064822211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064822211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064822213 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064822213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064822214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064822214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:23.195974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4000): Terminating (SIGTERM) 06:48:23.238089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4003): Terminating (SIGTERM) 06:48:23.280545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4006): Terminating (SIGTERM) 06:48:23.323381 --- ParallelTerminationStrategy: PID 4000 died... 06:48:23.343641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4000): Terminated: ok {rc=0} 06:48:23.391352 --- ParallelTerminationStrategy: PID 4003 died... 06:48:23.411282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4003): Terminated: ok {rc=0} 06:48:23.458293 --- ParallelTerminationStrategy: PID 4006 died... 06:48:23.478149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4006): Terminated: ok {rc=0} 06:48:23.567466 bus /sierra_3: Setting Powered False 06:48:24.667889 bus /sierra_3: Setting Powered False 06:48:25.787224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:48:27.045803 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:27.051501 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:48:27.098607 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:48:27.126194 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:48:27.176636 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:48:27.222228 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:48:27.249653 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:48:27.802993 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:48:27.808489 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:27.819703 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:48:27.856862 tst handover.py: using LAC 19680 06:48:27.974617 tst handover.py: using RAC 45 06:48:28.090944 tst handover.py: using CellId 19680 06:48:28.209882 tst handover.py: using BVCI 19681 06:48:28.319084 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:48:28.362102 tst handover.py: using LAC 19681 06:48:28.479129 tst handover.py: using RAC 46 06:48:28.595919 tst handover.py: using CellId 19681 06:48:28.723174 tst handover.py: using BVCI 19682 06:48:28.841429 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:28.853081 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:28.864470 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:28.876241 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:28.887954 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:48:28.899408 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:48:29.015332 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:48:29.133498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:29.609794 run create_hlr_db(pid=4012): Launched 06:48:29.733744 bus /sierra_2: Setting Powered False 06:48:30.797968 run create_hlr_db(pid=4012): Terminated: ok {rc=0} 06:48:31.309713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4014): Launched 06:48:31.630567 run osmo-hlr_10.42.42.2(pid=4015): Launched 06:48:31.907210 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:32.547172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4017): Launched 06:48:32.849404 run osmo-stp_10.42.42.5(pid=4018): Launched 06:48:32.964044 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:33.483782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4020): Launched 06:48:33.786966 run osmo-msc_10.42.42.6(pid=4021): Launched 06:48:33.955538 run osmo-stp_10.42.42.5(pid=4018): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4018)] 06:48:34.083677 run osmo-stp_10.42.42.5(pid=4018): stdout: | (launched: 2022-12-09_06:48:32.794096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:34.212150 run osmo-stp_10.42.42.5(pid=4018): stderr: | 20221209064832967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064832967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064832968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064832968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064832969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064832969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064832969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:34.338936 run osmo-stp_10.42.42.5(pid=4018): stdout: | (launched: 2022-12-09_06:48:32.794096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:34.459591 run osmo-stp_10.42.42.5(pid=4018): stderr: | 20221209064832967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064832967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064832968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064832968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064832969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064832969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064832969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:34.603046 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4018): Process ended prematurely: osmo-stp_10.42.42.5(pid=4018) [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4018)] [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 06:48:34.611317 tst handover.py:18: Test FAILED (6.8 sec) 06:48:34.637464 run osmo-hlr_10.42.42.2(pid=4015): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4015)] 06:48:34.685302 run osmo-hlr_10.42.42.2(pid=4015): stdout: | (launched: 2022-12-09_06:48:31.566756) 06:48:34.735074 run osmo-hlr_10.42.42.2(pid=4015): stderr: | 20221209064831858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064831858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064831858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064831858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064831858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064831858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064831877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064831890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064831890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064831891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:34.804322 run osmo-msc_10.42.42.6(pid=4021): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4021)] 06:48:34.852330 run osmo-msc_10.42.42.6(pid=4021): stdout: | (launched: 2022-12-09_06:48:33.731784) 06:48:34.902106 run osmo-msc_10.42.42.6(pid=4021): stderr: | 20221209064834001 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064834001 DLGLOBAL DEBUG validating counter group 0x7f529a773c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064834001 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064834001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064834001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064834002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064834003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064834004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064834004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064834004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:34.951933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4014): Terminating (SIGTERM) 06:48:34.991789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4017): Terminating (SIGTERM) 06:48:35.031762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4020): Terminating (SIGTERM) 06:48:35.071924 --- ParallelTerminationStrategy: PID 4014 died... 06:48:35.091134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4014): Terminated: ok {rc=0} 06:48:35.135421 --- ParallelTerminationStrategy: PID 4017 died... 06:48:35.154146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4017): Terminated: ok {rc=0} 06:48:35.198334 --- ParallelTerminationStrategy: PID 4020 died... 06:48:35.217037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4020): Terminated: ok {rc=0} 06:48:35.303036 bus /sierra_3: Setting Powered False 06:48:36.404046 bus /sierra_3: Setting Powered False 06:48:37.519426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:48:38.785065 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:38.791337 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:48:38.842347 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:48:38.868539 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:48:38.921704 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:48:38.972054 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:48:38.998786 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:48:39.547462 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:48:39.552515 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:39.563560 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:48:39.598456 tst handover.py: using LAC 19682 06:48:39.720361 tst handover.py: using RAC 47 06:48:39.839743 tst handover.py: using CellId 19682 06:48:39.960192 tst handover.py: using BVCI 19683 06:48:40.070912 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:48:40.120272 tst handover.py: using LAC 19683 06:48:40.240844 tst handover.py: using RAC 48 06:48:40.360613 tst handover.py: using CellId 19683 06:48:40.479056 tst handover.py: using BVCI 19684 06:48:40.590217 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:40.601172 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:40.611874 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:40.622640 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:40.633468 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:48:40.644117 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:48:40.762507 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:48:40.878199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:41.320332 run create_hlr_db(pid=4026): Launched 06:48:41.442853 bus /sierra_2: Setting Powered False 06:48:42.507089 run create_hlr_db(pid=4026): Terminated: ok {rc=0} 06:48:42.929739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Launched 06:48:43.253936 run osmo-hlr_10.42.42.2(pid=4029): Launched 06:48:43.376706 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:43.874451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Launched 06:48:44.176112 run osmo-stp_10.42.42.5(pid=4033): Launched 06:48:44.289843 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:44.807509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Launched 06:48:45.109661 run osmo-msc_10.42.42.6(pid=4036): Launched 06:48:45.279026 run osmo-stp_10.42.42.5(pid=4033): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] 06:48:45.407707 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-09_06:48:44.120794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:45.535983 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221209064844292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064844292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064844293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064844293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064844294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064844294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064844294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:45.662632 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-09_06:48:44.120794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:45.783658 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221209064844292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064844292 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064844293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064844293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064844294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064844294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064844294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:45.941607 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 06:48:45.950143 tst handover.py:18: Test FAILED (6.4 sec) 06:48:45.976688 run osmo-hlr_10.42.42.2(pid=4029): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4029)] 06:48:46.025623 run osmo-hlr_10.42.42.2(pid=4029): stdout: | (launched: 2022-12-09_06:48:43.195211) 06:48:46.076522 run osmo-hlr_10.42.42.2(pid=4029): stderr: | 20221209064843394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064843394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064843394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064843394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064843394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064843394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064843457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064843466 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064843466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064843466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:46.147134 run osmo-msc_10.42.42.6(pid=4036): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4036)] 06:48:46.195665 run osmo-msc_10.42.42.6(pid=4036): stdout: | (launched: 2022-12-09_06:48:45.054382) 06:48:46.246363 run osmo-msc_10.42.42.6(pid=4036): stderr: | 20221209064845325 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064845325 DLGLOBAL DEBUG validating counter group 0x7f79e9151c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064845326 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064845326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064845326 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064845326 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064845328 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064845328 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064845328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064845328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:46.297240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminating (SIGTERM) 06:48:46.338092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminating (SIGTERM) 06:48:46.379103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminating (SIGTERM) 06:48:46.421054 --- ParallelTerminationStrategy: PID 4028 died... 06:48:46.440639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminated: ok {rc=0} 06:48:46.487427 --- ParallelTerminationStrategy: PID 4031 died... 06:48:46.506755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminated: ok {rc=0} 06:48:46.551751 --- ParallelTerminationStrategy: PID 4035 died... 06:48:46.570837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminated: ok {rc=0} 06:48:46.656825 bus /sierra_3: Setting Powered False 06:48:47.754007 bus /sierra_3: Setting Powered False 06:48:48.866202 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 06:48:50.128560 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:48:50.134313 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:48:50.172829 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:48:50.200397 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:48:50.252820 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:48:50.290310 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:48:50.317499 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:48:50.869426 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 06:48:50.874855 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:50.886056 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:50.920351 tst handover.py: using LAC 19684 06:48:51.047526 tst handover.py: using RAC 49 06:48:51.168766 tst handover.py: using CellId 19684 06:48:51.290015 tst handover.py: using BVCI 19685 06:48:51.400860 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 06:48:51.435876 tst handover.py: using LAC 19685 06:48:51.555396 tst handover.py: using RAC 50 06:48:51.675104 tst handover.py: using CellId 19685 06:48:51.794798 tst handover.py: using BVCI 19686 06:48:51.915355 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:51.926624 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:51.937899 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:51.949472 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:51.961366 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:48:51.972715 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:52.090133 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 06:48:52.204702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:48:52.647367 run create_hlr_db(pid=4041): Launched 06:48:52.772223 bus /sierra_2: Setting Powered False 06:48:53.832129 run create_hlr_db(pid=4041): Terminated: ok {rc=0} 06:48:54.229446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Launched 06:48:54.531742 run osmo-hlr_10.42.42.2(pid=4044): Launched 06:48:54.646474 run osmo-stp_10.42.42.5: Starting osmo-stp 06:48:55.176857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Launched 06:48:55.502101 run osmo-stp_10.42.42.5(pid=4047): Launched 06:48:55.626486 run osmo-msc_10.42.42.6: Starting osmo-msc 06:48:56.185464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Launched 06:48:56.510738 run osmo-msc_10.42.42.6(pid=4050): Launched 06:48:56.693211 run osmo-stp_10.42.42.5(pid=4047): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] 06:48:56.829730 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-09_06:48:55.443211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:56.970314 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221209064855634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064855634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064855634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064855635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064855635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064855635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064855635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:57.107406 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-09_06:48:55.443211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:48:57.236548 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221209064855634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064855634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064855634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064855635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064855635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064855635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064855635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:48:57.391740 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4047): Process ended prematurely: osmo-stp_10.42.42.5(pid=4047) [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 06:48:57.400422 tst handover.py:18: Test FAILED (6.5 sec) 06:48:57.429240 run osmo-hlr_10.42.42.2(pid=4044): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4044)] 06:48:57.480463 run osmo-hlr_10.42.42.2(pid=4044): stdout: | (launched: 2022-12-09_06:48:54.476344) 06:48:57.533743 run osmo-hlr_10.42.42.2(pid=4044): stderr: | 20221209064854656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064854656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064854656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064854656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064854656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064854656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064854677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064854687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064854687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064854687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:48:57.607278 run osmo-msc_10.42.42.6(pid=4050): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4050)] 06:48:57.657770 run osmo-msc_10.42.42.6(pid=4050): stdout: | (launched: 2022-12-09_06:48:56.451582) 06:48:57.710021 run osmo-msc_10.42.42.6(pid=4050): stderr: | 20221209064856775 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064856775 DLGLOBAL DEBUG validating counter group 0x7f01060c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064856775 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064856775 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064856775 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064856776 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064856777 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064856778 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064856778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064856778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:48:57.762430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminating (SIGTERM) 06:48:57.804484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminating (SIGTERM) 06:48:57.846782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminating (SIGTERM) 06:48:57.889048 --- ParallelTerminationStrategy: PID 4043 died... 06:48:57.908905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminated: ok {rc=0} 06:48:57.955730 --- ParallelTerminationStrategy: PID 4046 died... 06:48:57.975286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminated: ok {rc=0} 06:48:58.021570 --- ParallelTerminationStrategy: PID 4049 died... 06:48:58.041179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminated: ok {rc=0} 06:48:58.130045 bus /sierra_3: Setting Powered False 06:48:59.230109 bus /sierra_3: Setting Powered False 06:49:00.346837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 06:49:01.629531 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:01.636901 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:49:01.688531 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:49:01.715924 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:49:01.767468 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:49:01.817001 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:49:01.845832 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:49:02.396172 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 06:49:02.401423 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:02.414347 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:02.447173 tst handover.py: using LAC 19686 06:49:02.565395 tst handover.py: using RAC 51 06:49:02.696662 tst handover.py: using CellId 19686 06:49:02.824710 tst handover.py: using BVCI 19687 06:49:02.942781 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:02.990750 tst handover.py: using LAC 19687 06:49:03.118070 tst handover.py: using RAC 52 06:49:03.244076 tst handover.py: using CellId 19687 06:49:03.369907 tst handover.py: using BVCI 19688 06:49:03.488143 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:03.499388 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:03.510637 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:03.522248 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:03.533838 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:03.545358 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:03.664927 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:49:03.784029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:04.233211 run create_hlr_db(pid=4055): Launched 06:49:04.358637 bus /sierra_2: Setting Powered False 06:49:05.418357 run create_hlr_db(pid=4055): Terminated: ok {rc=0} 06:49:05.812601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4057): Launched 06:49:06.115475 run osmo-hlr_10.42.42.2(pid=4058): Launched 06:49:06.230413 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:06.722552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4060): Launched 06:49:07.023017 run osmo-stp_10.42.42.5(pid=4061): Launched 06:49:07.137424 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:07.657584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4063): Launched 06:49:07.960698 run osmo-msc_10.42.42.6(pid=4064): Launched 06:49:08.128886 run osmo-stp_10.42.42.5(pid=4061): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4061)] 06:49:08.257110 run osmo-stp_10.42.42.5(pid=4061): stdout: | (launched: 2022-12-09_06:49:06.967785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:08.385180 run osmo-stp_10.42.42.5(pid=4061): stderr: | 20221209064907140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064907140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064907140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064907140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064907141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064907141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064907141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:08.511228 run osmo-stp_10.42.42.5(pid=4061): stdout: | (launched: 2022-12-09_06:49:06.967785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:08.631390 run osmo-stp_10.42.42.5(pid=4061): stderr: | 20221209064907140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064907140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064907140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064907140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064907141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064907141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064907141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:08.774704 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4061): Process ended prematurely: osmo-stp_10.42.42.5(pid=4061) [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4061)] [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 06:49:08.782992 tst handover.py:18: Test FAILED (6.4 sec) 06:49:08.809070 run osmo-hlr_10.42.42.2(pid=4058): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4058)] 06:49:08.856872 run osmo-hlr_10.42.42.2(pid=4058): stdout: | (launched: 2022-12-09_06:49:06.060271) 06:49:08.906747 run osmo-hlr_10.42.42.2(pid=4058): stderr: | 20221209064906236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064906236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064906236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064906236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064906236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064906236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064906247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064906257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064906258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064906258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:08.976348 run osmo-msc_10.42.42.6(pid=4064): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4064)] 06:49:09.024283 run osmo-msc_10.42.42.6(pid=4064): stdout: | (launched: 2022-12-09_06:49:07.905597) 06:49:09.073976 run osmo-msc_10.42.42.6(pid=4064): stderr: | 20221209064908177 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064908177 DLGLOBAL DEBUG validating counter group 0x7fe344663c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064908177 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064908177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064908177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064908178 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064908180 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064908181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064908181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064908181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:09.124086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4057): Terminating (SIGTERM) 06:49:09.163873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4060): Terminating (SIGTERM) 06:49:09.203918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4063): Terminating (SIGTERM) 06:49:09.244065 --- ParallelTerminationStrategy: PID 4057 died... 06:49:09.263130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4057): Terminated: ok {rc=0} 06:49:09.307115 --- ParallelTerminationStrategy: PID 4060 died... 06:49:09.325717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4060): Terminated: ok {rc=0} 06:49:09.369545 --- ParallelTerminationStrategy: PID 4063 died... 06:49:09.388057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4063): Terminated: ok {rc=0} 06:49:09.472100 bus /sierra_3: Setting Powered False 06:49:10.566754 bus /sierra_3: Setting Powered False 06:49:11.680321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 06:49:12.936790 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:12.942542 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:49:12.993115 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:49:13.020496 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:49:13.074891 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:49:13.125539 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:49:13.153112 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:49:13.701214 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 06:49:13.706852 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:13.718314 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:13.754049 tst handover.py: using LAC 19688 06:49:13.882894 tst handover.py: using RAC 53 06:49:14.009929 tst handover.py: using CellId 19688 06:49:14.135380 tst handover.py: using BVCI 19689 06:49:14.253261 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:49:14.300188 tst handover.py: using LAC 19689 06:49:14.425177 tst handover.py: using RAC 54 06:49:14.550775 tst handover.py: using CellId 19689 06:49:14.677326 tst handover.py: using BVCI 19690 06:49:14.795350 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:14.807011 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:14.818313 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:14.830018 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:14.841793 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:49:14.853479 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:14.969209 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:49:15.090806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:15.565493 run create_hlr_db(pid=4069): Launched 06:49:15.689042 bus /sierra_2: Setting Powered False 06:49:16.749230 run create_hlr_db(pid=4069): Terminated: ok {rc=0} 06:49:17.163025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Launched 06:49:17.470295 run osmo-hlr_10.42.42.2(pid=4072): Launched 06:49:17.585290 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:18.082298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Launched 06:49:18.384527 run osmo-stp_10.42.42.5(pid=4075): Launched 06:49:18.499386 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:19.022099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4077): Launched 06:49:19.323869 run osmo-msc_10.42.42.6(pid=4078): Launched 06:49:19.492116 run osmo-stp_10.42.42.5(pid=4075): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] 06:49:19.620049 run osmo-stp_10.42.42.5(pid=4075): stdout: | (launched: 2022-12-09_06:49:18.329121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.747244 run osmo-stp_10.42.42.5(pid=4075): stderr: | 20221209064918502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064918502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064918502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064918503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064918503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064918503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064918503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:19.873290 run osmo-stp_10.42.42.5(pid=4075): stdout: | (launched: 2022-12-09_06:49:18.329121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:19.993431 run osmo-stp_10.42.42.5(pid=4075): stderr: | 20221209064918502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064918502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064918502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064918503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064918503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064918503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064918503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:20.137264 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4075): Process ended prematurely: osmo-stp_10.42.42.5(pid=4075) [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 06:49:20.145414 tst handover.py:18: Test FAILED (6.4 sec) 06:49:20.171582 run osmo-hlr_10.42.42.2(pid=4072): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4072)] 06:49:20.219209 run osmo-hlr_10.42.42.2(pid=4072): stdout: | (launched: 2022-12-09_06:49:17.415271) 06:49:20.268856 run osmo-hlr_10.42.42.2(pid=4072): stderr: | 20221209064917592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064917592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064917593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064917593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064917593 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064917593 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064917606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064917614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064917614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064917615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:20.338187 run osmo-msc_10.42.42.6(pid=4078): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4078)] 06:49:20.385715 run osmo-msc_10.42.42.6(pid=4078): stdout: | (launched: 2022-12-09_06:49:19.268626) 06:49:20.434978 run osmo-msc_10.42.42.6(pid=4078): stderr: | 20221209064919539 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064919539 DLGLOBAL DEBUG validating counter group 0x7f60abbabc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064919539 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064919539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064919539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064919540 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064919541 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064919542 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064919542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064919542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:20.484497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Terminating (SIGTERM) 06:49:20.523942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Terminating (SIGTERM) 06:49:20.563687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4077): Terminating (SIGTERM) 06:49:20.603762 --- ParallelTerminationStrategy: PID 4071 died... 06:49:20.622888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4071): Terminated: ok {rc=0} 06:49:20.667012 --- ParallelTerminationStrategy: PID 4074 died... 06:49:20.685606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4074): Terminated: ok {rc=0} 06:49:20.729429 --- ParallelTerminationStrategy: PID 4077 died... 06:49:20.747891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4077): Terminated: ok {rc=0} 06:49:20.832564 bus /sierra_3: Setting Powered False 06:49:21.931334 bus /sierra_3: Setting Powered False 06:49:23.049561 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 06:49:24.307370 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:24.313123 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 06:49:24.374177 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 06:49:24.402075 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 06:49:24.454939 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 06:49:24.515923 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 06:49:24.543217 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 06:49:25.096085 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 06:49:25.101897 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:25.113445 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:49:25.162359 tst handover.py: using LAC 19690 06:49:25.290581 tst handover.py: using RAC 55 06:49:25.418880 tst handover.py: using CellId 19690 06:49:25.547891 tst handover.py: using BVCI 19691 06:49:25.665320 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 06:49:25.710506 tst handover.py: using LAC 19691 06:49:25.838755 tst handover.py: using RAC 56 06:49:25.964862 tst handover.py: using CellId 19691 06:49:26.090852 tst handover.py: using BVCI 19692 06:49:26.209643 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:26.221302 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:26.232699 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:26.244601 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:26.256923 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 06:49:26.268645 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:49:26.384893 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 06:49:26.500184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:26.942593 run create_hlr_db(pid=4084): Launched 06:49:27.064785 bus /sierra_2: Setting Powered False 06:49:28.125479 run create_hlr_db(pid=4084): Terminated: ok {rc=0} 06:49:28.521254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4086): Launched 06:49:28.822994 run osmo-hlr_10.42.42.2(pid=4087): Launched 06:49:28.937691 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:29.429721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4089): Launched 06:49:29.732011 run osmo-stp_10.42.42.5(pid=4090): Launched 06:49:29.846652 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:30.369305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4092): Launched 06:49:30.672313 run osmo-msc_10.42.42.6(pid=4093): Launched 06:49:30.841539 run osmo-stp_10.42.42.5(pid=4090): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4090)] 06:49:31.091151 run osmo-stp_10.42.42.5(pid=4090): stdout: | (launched: 2022-12-09_06:49:29.676809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:31.329913 run osmo-stp_10.42.42.5(pid=4090): stderr: | 20221209064929845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064929845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064929845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064929846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064929848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064929848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064929848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:31.514548 run osmo-stp_10.42.42.5(pid=4090): stdout: | (launched: 2022-12-09_06:49:29.676809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:31.693463 run osmo-stp_10.42.42.5(pid=4090): stderr: | 20221209064929845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064929845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064929845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064929846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064929848 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064929848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064929848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:31.900793 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4090): Process ended prematurely: osmo-stp_10.42.42.5(pid=4090) [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4090)] [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 06:49:31.909733 tst handover.py:18: Test FAILED (6.8 sec) 06:49:31.936767 run osmo-hlr_10.42.42.2(pid=4087): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4087)] 06:49:31.986143 run osmo-hlr_10.42.42.2(pid=4087): stdout: | (launched: 2022-12-09_06:49:28.767550) 06:49:32.036520 run osmo-hlr_10.42.42.2(pid=4087): stderr: | 20221209064928947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064928947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064928947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064928947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064928947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064928947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064928959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064928968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064928968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064928968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:32.107950 run osmo-msc_10.42.42.6(pid=4093): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4093)] 06:49:32.156769 run osmo-msc_10.42.42.6(pid=4093): stdout: | (launched: 2022-12-09_06:49:30.616871) 06:49:32.206997 run osmo-msc_10.42.42.6(pid=4093): stderr: | 20221209064930994 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064930995 DLGLOBAL DEBUG validating counter group 0x7ffa7cc75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064930995 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064930995 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064930995 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064930995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064930997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064930998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064930998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064930998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:32.258065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4086): Terminating (SIGTERM) 06:49:32.300335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4089): Terminating (SIGTERM) 06:49:32.342132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4092): Terminating (SIGTERM) 06:49:32.383605 --- ParallelTerminationStrategy: PID 4086 died... 06:49:32.402956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4086): Terminated: ok {rc=0} 06:49:32.448539 --- ParallelTerminationStrategy: PID 4089 died... 06:49:32.467612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4089): Terminated: ok {rc=0} 06:49:32.511907 --- ParallelTerminationStrategy: PID 4092 died... 06:49:32.530833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4092): Terminated: ok {rc=0} 06:49:32.616321 bus /sierra_3: Setting Powered False 06:49:33.715607 bus /sierra_3: Setting Powered False 06:49:34.827730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:49:36.088259 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:36.093232 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:49:36.156272 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:49:36.182481 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:49:36.234049 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:49:36.298249 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:49:36.324435 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:49:36.873098 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:49:36.878160 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:36.888887 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:36.935459 tst handover.py: using LAC 19692 06:49:37.054212 tst handover.py: using RAC 57 06:49:37.173899 tst handover.py: using CellId 19692 06:49:37.291910 tst handover.py: using BVCI 19693 06:49:37.402384 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:49:37.450595 tst handover.py: using LAC 19693 06:49:37.570432 tst handover.py: using RAC 58 06:49:37.692881 tst handover.py: using CellId 19693 06:49:37.809137 tst handover.py: using BVCI 19694 06:49:37.918176 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.929178 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.939841 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.950677 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.961403 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:49:37.972062 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:38.085530 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:49:38.206464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:38.683745 run create_hlr_db(pid=4098): Launched 06:49:38.808069 bus /sierra_2: Setting Powered False 06:49:39.872724 run create_hlr_db(pid=4098): Terminated: ok {rc=0} 06:49:40.298881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4100): Launched 06:49:40.624529 run osmo-hlr_10.42.42.2(pid=4101): Launched 06:49:40.748484 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:41.258058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4103): Launched 06:49:41.559854 run osmo-stp_10.42.42.5(pid=4104): Launched 06:49:41.675149 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:42.197209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4106): Launched 06:49:42.499886 run osmo-msc_10.42.42.6(pid=4107): Launched 06:49:42.668542 run osmo-stp_10.42.42.5(pid=4104): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4104)] 06:49:42.797202 run osmo-stp_10.42.42.5(pid=4104): stdout: | (launched: 2022-12-09_06:49:41.504384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:42.925647 run osmo-stp_10.42.42.5(pid=4104): stderr: | 20221209064941676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064941676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064941677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064941677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064941678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064941678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064941678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:43.052117 run osmo-stp_10.42.42.5(pid=4104): stdout: | (launched: 2022-12-09_06:49:41.504384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:43.172318 run osmo-stp_10.42.42.5(pid=4104): stderr: | 20221209064941676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064941676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064941677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064941677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064941678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064941678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064941678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:43.316166 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4104): Process ended prematurely: osmo-stp_10.42.42.5(pid=4104) [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4104)] [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 06:49:43.324425 tst handover.py:18: Test FAILED (6.4 sec) 06:49:43.350823 run osmo-hlr_10.42.42.2(pid=4101): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4101)] 06:49:43.399070 run osmo-hlr_10.42.42.2(pid=4101): stdout: | (launched: 2022-12-09_06:49:40.565825) 06:49:43.449835 run osmo-hlr_10.42.42.2(pid=4101): stderr: | 20221209064940768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064940768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064940768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064940768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064940768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064940768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064940780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064940790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064940790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064940790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:43.519808 run osmo-msc_10.42.42.6(pid=4107): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4107)] 06:49:43.567906 run osmo-msc_10.42.42.6(pid=4107): stdout: | (launched: 2022-12-09_06:49:42.444478) 06:49:43.617836 run osmo-msc_10.42.42.6(pid=4107): stderr: | 20221209064942717 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064942717 DLGLOBAL DEBUG validating counter group 0x7fae96a6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064942717 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064942717 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064942717 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064942717 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064942720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064942721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064942721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064942721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:43.667878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4100): Terminating (SIGTERM) 06:49:43.707920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4103): Terminating (SIGTERM) 06:49:43.748068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4106): Terminating (SIGTERM) 06:49:43.788728 --- ParallelTerminationStrategy: PID 4100 died... 06:49:43.808049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4100): Terminated: ok {rc=0} 06:49:43.852839 --- ParallelTerminationStrategy: PID 4103 died... 06:49:43.872268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4103): Terminated: ok {rc=0} 06:49:43.916813 --- ParallelTerminationStrategy: PID 4106 died... 06:49:43.935777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4106): Terminated: ok {rc=0} 06:49:44.021000 bus /sierra_3: Setting Powered False 06:49:45.119877 bus /sierra_3: Setting Powered False 06:49:46.239667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 06:49:47.515276 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:47.520283 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:49:47.570031 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:49:47.596409 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:49:47.645938 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:49:47.695490 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:49:47.721760 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:49:48.274638 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 06:49:48.279988 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:48.290883 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:48.341517 tst handover.py: using LAC 19694 06:49:48.470248 tst handover.py: using RAC 59 06:49:48.596220 tst handover.py: using CellId 19694 06:49:48.722347 tst handover.py: using BVCI 19695 06:49:48.840354 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 06:49:48.875471 tst handover.py: using LAC 19695 06:49:49.002246 tst handover.py: using RAC 60 06:49:49.128182 tst handover.py: using CellId 19695 06:49:49.246447 tst handover.py: using BVCI 19696 06:49:49.358295 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.369297 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.379830 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.390652 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.401554 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:49:49.411980 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:49.524660 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 06:49:49.639430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:49:50.080639 run create_hlr_db(pid=4112): Launched 06:49:50.203698 bus /sierra_2: Setting Powered False 06:49:51.263613 run create_hlr_db(pid=4112): Terminated: ok {rc=0} 06:49:51.659412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4114): Launched 06:49:51.962802 run osmo-hlr_10.42.42.2(pid=4115): Launched 06:49:52.076621 run osmo-stp_10.42.42.5: Starting osmo-stp 06:49:52.571940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4117): Launched 06:49:52.873715 run osmo-stp_10.42.42.5(pid=4118): Launched 06:49:52.988550 run osmo-msc_10.42.42.6: Starting osmo-msc 06:49:53.509549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4120): Launched 06:49:53.811680 run osmo-msc_10.42.42.6(pid=4121): Launched 06:49:53.980011 run osmo-stp_10.42.42.5(pid=4118): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4118)] 06:49:54.107803 run osmo-stp_10.42.42.5(pid=4118): stdout: | (launched: 2022-12-09_06:49:52.818640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.236015 run osmo-stp_10.42.42.5(pid=4118): stderr: | 20221209064952990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064952990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064952991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064952991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064952991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064952991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064952991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.362785 run osmo-stp_10.42.42.5(pid=4118): stdout: | (launched: 2022-12-09_06:49:52.818640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:49:54.483159 run osmo-stp_10.42.42.5(pid=4118): stderr: | 20221209064952990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209064952990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209064952991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209064952991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209064952991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209064952991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209064952991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:49:54.626892 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4118): Process ended prematurely: osmo-stp_10.42.42.5(pid=4118) [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4118)] [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 06:49:54.635082 tst handover.py:18: Test FAILED (6.3 sec) 06:49:54.661499 run osmo-hlr_10.42.42.2(pid=4115): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4115)] 06:49:54.710040 run osmo-hlr_10.42.42.2(pid=4115): stdout: | (launched: 2022-12-09_06:49:51.906847) 06:49:54.760597 run osmo-hlr_10.42.42.2(pid=4115): stderr: | 20221209064952083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209064952083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209064952083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209064952083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209064952083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209064952083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209064952095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209064952104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209064952104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209064952104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:49:54.830692 run osmo-msc_10.42.42.6(pid=4121): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4121)] 06:49:54.878851 run osmo-msc_10.42.42.6(pid=4121): stdout: | (launched: 2022-12-09_06:49:53.756367) 06:49:54.928698 run osmo-msc_10.42.42.6(pid=4121): stderr: | 20221209064954028 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209064954028 DLGLOBAL DEBUG validating counter group 0x7ff9b71ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209064954028 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209064954028 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209064954029 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209064954029 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209064954032 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209064954032 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209064954032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209064954032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:49:54.978994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4114): Terminating (SIGTERM) 06:49:55.019063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4117): Terminating (SIGTERM) 06:49:55.059338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4120): Terminating (SIGTERM) 06:49:55.099693 --- ParallelTerminationStrategy: PID 4114 died... 06:49:55.119082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4114): Terminated: ok {rc=0} 06:49:55.163734 --- ParallelTerminationStrategy: PID 4117 died... 06:49:55.182627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4117): Terminated: ok {rc=0} 06:49:55.227216 --- ParallelTerminationStrategy: PID 4120 died... 06:49:55.245906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4120): Terminated: ok {rc=0} 06:49:55.332401 bus /sierra_3: Setting Powered False 06:49:56.433204 bus /sierra_3: Setting Powered False 06:49:57.547591 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 06:49:58.811142 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:49:58.816826 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:49:58.882386 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:49:58.910394 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:49:58.962866 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:49:59.027629 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:49:59.055477 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:49:59.607447 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 06:49:59.613216 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:49:59.624589 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:49:59.673746 tst handover.py: using LAC 19696 06:49:59.802979 tst handover.py: using RAC 61 06:49:59.930260 tst handover.py: using CellId 19696 06:50:00.058541 tst handover.py: using BVCI 19697 06:50:00.176023 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:00.225878 tst handover.py: using LAC 19697 06:50:00.354286 tst handover.py: using RAC 62 06:50:00.483602 tst handover.py: using CellId 19697 06:50:00.605576 tst handover.py: using BVCI 19698 06:50:00.726111 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.737637 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.748998 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.761115 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.773149 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:00.785200 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:00.923215 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:01.048836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:01.585846 run create_hlr_db(pid=4129): Launched 06:50:01.748039 bus /sierra_2: Setting Powered False 06:50:02.809246 run create_hlr_db(pid=4129): Terminated: ok {rc=0} 06:50:03.207982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4131): Launched 06:50:03.511241 run osmo-hlr_10.42.42.2(pid=4132): Launched 06:50:03.625753 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:04.120085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4134): Launched 06:50:04.423519 run osmo-stp_10.42.42.5(pid=4135): Launched 06:50:04.538352 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:05.063679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4137): Launched 06:50:05.366068 run osmo-msc_10.42.42.6(pid=4138): Launched 06:50:05.534900 run osmo-stp_10.42.42.5(pid=4135): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4135)] 06:50:05.663171 run osmo-stp_10.42.42.5(pid=4135): stdout: | (launched: 2022-12-09_06:50:04.367826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:05.791174 run osmo-stp_10.42.42.5(pid=4135): stderr: | 20221209065004539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065004539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065004539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065004540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065004542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065004542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065004542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:05.917773 run osmo-stp_10.42.42.5(pid=4135): stdout: | (launched: 2022-12-09_06:50:04.367826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:06.037771 run osmo-stp_10.42.42.5(pid=4135): stderr: | 20221209065004539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065004539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065004539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065004540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065004542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065004542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065004542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:06.181882 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4135): Process ended prematurely: osmo-stp_10.42.42.5(pid=4135) [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4135)] [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 06:50:06.189933 tst handover.py:18: Test FAILED (6.6 sec) 06:50:06.216368 run osmo-hlr_10.42.42.2(pid=4132): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4132)] 06:50:06.264480 run osmo-hlr_10.42.42.2(pid=4132): stdout: | (launched: 2022-12-09_06:50:03.455891) 06:50:06.314709 run osmo-hlr_10.42.42.2(pid=4132): stderr: | 20221209065003631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065003631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065003631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065003631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065003631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065003631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065003646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065003657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065003657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065003658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:06.385018 run osmo-msc_10.42.42.6(pid=4138): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4138)] 06:50:06.432901 run osmo-msc_10.42.42.6(pid=4138): stdout: | (launched: 2022-12-09_06:50:05.310401) 06:50:06.482960 run osmo-msc_10.42.42.6(pid=4138): stderr: | 20221209065005584 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065005584 DLGLOBAL DEBUG validating counter group 0x7fe34c491c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065005584 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065005584 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065005584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065005585 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065005586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065005587 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065005587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065005587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:06.533182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4131): Terminating (SIGTERM) 06:50:06.573335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4134): Terminating (SIGTERM) 06:50:06.613710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4137): Terminating (SIGTERM) 06:50:06.654213 --- ParallelTerminationStrategy: PID 4131 died... 06:50:06.673645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4131): Terminated: ok {rc=0} 06:50:06.718510 --- ParallelTerminationStrategy: PID 4134 died... 06:50:06.737541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4134): Terminated: ok {rc=0} 06:50:06.782143 --- ParallelTerminationStrategy: PID 4137 died... 06:50:06.801145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4137): Terminated: ok {rc=0} 06:50:06.885235 bus /sierra_3: Setting Powered False 06:50:07.980731 bus /sierra_3: Setting Powered False 06:50:09.096583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 06:50:10.371002 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:10.376171 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:50:10.437767 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:50:10.464089 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:50:10.513722 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:50:10.574815 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:50:10.600931 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:50:11.153362 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 06:50:11.158414 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:11.169229 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:11.216027 tst handover.py: using LAC 19698 06:50:11.333227 tst handover.py: using RAC 63 06:50:11.460042 tst handover.py: using CellId 19698 06:50:11.577894 tst handover.py: using BVCI 19699 06:50:11.689264 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:11.735228 tst handover.py: using LAC 19699 06:50:11.852186 tst handover.py: using RAC 64 06:50:11.969901 tst handover.py: using CellId 19699 06:50:12.089250 tst handover.py: using BVCI 19700 06:50:12.198708 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.209671 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.220154 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.230814 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.241479 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:12.251968 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:12.369748 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:12.492093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:12.967710 run create_hlr_db(pid=4143): Launched 06:50:13.091863 bus /sierra_2: Setting Powered False 06:50:14.157028 run create_hlr_db(pid=4143): Terminated: ok {rc=0} 06:50:14.582225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4145): Launched 06:50:14.906268 run osmo-hlr_10.42.42.2(pid=4146): Launched 06:50:15.030026 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:15.562081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4148): Launched 06:50:15.897728 run osmo-stp_10.42.42.5(pid=4149): Launched 06:50:16.145526 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:16.813662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4151): Launched 06:50:17.149688 run osmo-msc_10.42.42.6(pid=4152): Launched 06:50:17.379104 run osmo-stp_10.42.42.5(pid=4149): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4149)] 06:50:17.517751 run osmo-stp_10.42.42.5(pid=4149): stdout: | (launched: 2022-12-09_06:50:15.827503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:17.655888 run osmo-stp_10.42.42.5(pid=4149): stderr: | 20221209065016150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065016150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065016151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065016151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065016151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065016151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065016152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:17.792673 run osmo-stp_10.42.42.5(pid=4149): stdout: | (launched: 2022-12-09_06:50:15.827503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:17.922457 run osmo-stp_10.42.42.5(pid=4149): stderr: | 20221209065016150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065016150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065016151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065016151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065016151 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065016151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065016152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:18.078075 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4149): Process ended prematurely: osmo-stp_10.42.42.5(pid=4149) [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4149)] [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 06:50:18.087224 tst handover.py:18: Test FAILED (6.9 sec) 06:50:18.116132 run osmo-hlr_10.42.42.2(pid=4146): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4146)] 06:50:18.167321 run osmo-hlr_10.42.42.2(pid=4146): stdout: | (launched: 2022-12-09_06:50:14.847496) 06:50:18.220433 run osmo-hlr_10.42.42.2(pid=4146): stderr: | 20221209065015045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065015045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065015045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065015045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065015045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065015045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065015058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065015066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065015066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065015066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:18.293983 run osmo-msc_10.42.42.6(pid=4152): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4152)] 06:50:18.345150 run osmo-msc_10.42.42.6(pid=4152): stdout: | (launched: 2022-12-09_06:50:17.080877) 06:50:18.398159 run osmo-msc_10.42.42.6(pid=4152): stderr: | 20221209065017442 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065017443 DLGLOBAL DEBUG validating counter group 0x7f26802c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065017443 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065017443 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065017443 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065017443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065017445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065017445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065017445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065017445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:18.451551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4145): Terminating (SIGTERM) 06:50:18.495422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4148): Terminating (SIGTERM) 06:50:18.538823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4151): Terminating (SIGTERM) 06:50:18.582756 --- ParallelTerminationStrategy: PID 4145 died... 06:50:18.603165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4145): Terminated: ok {rc=0} 06:50:18.651332 --- ParallelTerminationStrategy: PID 4148 died... 06:50:18.671359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4148): Terminated: ok {rc=0} 06:50:18.718971 --- ParallelTerminationStrategy: PID 4151 died... 06:50:18.738848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4151): Terminated: ok {rc=0} 06:50:18.828388 bus /sierra_3: Setting Powered False 06:50:19.928444 bus /sierra_3: Setting Powered False 06:50:21.045770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 06:50:22.319939 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:22.325452 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 06:50:22.386477 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 06:50:22.414013 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 06:50:22.466045 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 06:50:22.527345 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 06:50:22.554651 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 06:50:23.112932 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 06:50:23.118330 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:23.129964 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:50:23.174770 tst handover.py: using LAC 19700 06:50:23.300639 tst handover.py: using RAC 65 06:50:23.425968 tst handover.py: using CellId 19700 06:50:23.551702 tst handover.py: using BVCI 19701 06:50:23.663816 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 06:50:23.712088 tst handover.py: using LAC 19701 06:50:23.829864 tst handover.py: using RAC 66 06:50:23.957361 tst handover.py: using CellId 19701 06:50:24.084238 tst handover.py: using BVCI 19702 06:50:24.202016 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.213820 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.225523 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.237446 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.249109 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 06:50:24.260683 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:50:24.376038 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 06:50:24.491193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:24.935885 run create_hlr_db(pid=4158): Launched 06:50:25.059504 bus /sierra_2: Setting Powered False 06:50:26.119344 run create_hlr_db(pid=4158): Terminated: ok {rc=0} 06:50:26.515528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Launched 06:50:26.818353 run osmo-hlr_10.42.42.2(pid=4161): Launched 06:50:26.932569 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:27.425384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Launched 06:50:27.728220 run osmo-stp_10.42.42.5(pid=4164): Launched 06:50:27.843058 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:28.367182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Launched 06:50:28.670080 run osmo-msc_10.42.42.6(pid=4167): Launched 06:50:28.838092 run osmo-stp_10.42.42.5(pid=4164): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] 06:50:28.965469 run osmo-stp_10.42.42.5(pid=4164): stdout: | (launched: 2022-12-09_06:50:27.672675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:29.093456 run osmo-stp_10.42.42.5(pid=4164): stderr: | 20221209065027842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065027842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065027843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065027843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065027843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065027844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065027844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.219730 run osmo-stp_10.42.42.5(pid=4164): stdout: | (launched: 2022-12-09_06:50:27.672675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:29.339997 run osmo-stp_10.42.42.5(pid=4164): stderr: | 20221209065027842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065027842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065027843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065027843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065027843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065027844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065027844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:29.483820 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4164): Process ended prematurely: osmo-stp_10.42.42.5(pid=4164) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 06:50:29.492091 tst handover.py:18: Test FAILED (6.4 sec) 06:50:29.518674 run osmo-hlr_10.42.42.2(pid=4161): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4161)] 06:50:29.567137 run osmo-hlr_10.42.42.2(pid=4161): stdout: | (launched: 2022-12-09_06:50:26.762782) 06:50:29.617456 run osmo-hlr_10.42.42.2(pid=4161): stderr: | 20221209065026941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065026941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065026941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065026941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065026941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065026941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065026953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065026962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065026962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065026962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:29.687358 run osmo-msc_10.42.42.6(pid=4167): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4167)] 06:50:29.735431 run osmo-msc_10.42.42.6(pid=4167): stdout: | (launched: 2022-12-09_06:50:28.614675) 06:50:29.785164 run osmo-msc_10.42.42.6(pid=4167): stderr: | 20221209065028885 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065028886 DLGLOBAL DEBUG validating counter group 0x7f3b26745c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065028886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065028886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065028886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065028886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065028888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065028888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065028888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065028888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:29.835535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Terminating (SIGTERM) 06:50:29.875665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Terminating (SIGTERM) 06:50:29.915840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Terminating (SIGTERM) 06:50:29.956147 --- ParallelTerminationStrategy: PID 4160 died... 06:50:29.975501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4160): Terminated: ok {rc=0} 06:50:30.019748 --- ParallelTerminationStrategy: PID 4163 died... 06:50:30.038677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4163): Terminated: ok {rc=0} 06:50:30.082872 --- ParallelTerminationStrategy: PID 4166 died... 06:50:30.101719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4166): Terminated: ok {rc=0} 06:50:30.185758 bus /sierra_3: Setting Powered False 06:50:31.285858 bus /sierra_3: Setting Powered False 06:50:32.402266 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 06:50:33.672569 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:33.678215 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:50:33.726245 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:50:33.753612 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:50:33.807353 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:50:33.855264 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:50:33.882623 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:50:34.434018 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 06:50:34.439375 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:34.450770 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:34.495725 tst handover.py: using LAC 19702 06:50:34.626964 tst handover.py: using RAC 67 06:50:34.753690 tst handover.py: using CellId 19702 06:50:34.880488 tst handover.py: using BVCI 19703 06:50:34.997653 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 06:50:35.032575 tst handover.py: using LAC 19703 06:50:35.157442 tst handover.py: using RAC 68 06:50:35.276870 tst handover.py: using CellId 19703 06:50:35.394423 tst handover.py: using BVCI 19704 06:50:35.504466 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.515723 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.526846 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.538019 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.549206 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:50:35.560346 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:35.680007 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 06:50:35.799330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:36.274597 run create_hlr_db(pid=4172): Launched 06:50:36.399079 bus /sierra_2: Setting Powered False 06:50:37.463225 run create_hlr_db(pid=4172): Terminated: ok {rc=0} 06:50:37.871129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4174): Launched 06:50:38.173977 run osmo-hlr_10.42.42.2(pid=4175): Launched 06:50:38.289450 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:38.785166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4177): Launched 06:50:39.088161 run osmo-stp_10.42.42.5(pid=4178): Launched 06:50:39.202910 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:39.725509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4180): Launched 06:50:40.028257 run osmo-msc_10.42.42.6(pid=4181): Launched 06:50:40.196056 run osmo-stp_10.42.42.5(pid=4178): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4178)] 06:50:40.323837 run osmo-stp_10.42.42.5(pid=4178): stdout: | (launched: 2022-12-09_06:50:39.032616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:40.451747 run osmo-stp_10.42.42.5(pid=4178): stderr: | 20221209065039204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065039204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065039204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065039205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065039205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065039205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065039205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:40.577486 run osmo-stp_10.42.42.5(pid=4178): stdout: | (launched: 2022-12-09_06:50:39.032616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:40.697870 run osmo-stp_10.42.42.5(pid=4178): stderr: | 20221209065039204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065039204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065039204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065039205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065039205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065039205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065039205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:40.840893 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4178): Process ended prematurely: osmo-stp_10.42.42.5(pid=4178) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4178)] [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 06:50:40.849138 tst handover.py:18: Test FAILED (6.4 sec) 06:50:40.875391 run osmo-hlr_10.42.42.2(pid=4175): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4175)] 06:50:40.923067 run osmo-hlr_10.42.42.2(pid=4175): stdout: | (launched: 2022-12-09_06:50:38.118562) 06:50:40.972501 run osmo-hlr_10.42.42.2(pid=4175): stderr: | 20221209065038293 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065038293 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065038293 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065038293 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065038293 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065038293 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065038306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065038314 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065038315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065038315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:41.041613 run osmo-msc_10.42.42.6(pid=4181): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4181)] 06:50:41.089395 run osmo-msc_10.42.42.6(pid=4181): stdout: | (launched: 2022-12-09_06:50:39.972802) 06:50:41.139092 run osmo-msc_10.42.42.6(pid=4181): stderr: | 20221209065040244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065040244 DLGLOBAL DEBUG validating counter group 0x7f3db6806c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065040245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065040245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065040245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065040245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065040247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065040247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065040247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065040247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:41.188768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4174): Terminating (SIGTERM) 06:50:41.228496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4177): Terminating (SIGTERM) 06:50:41.268036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4180): Terminating (SIGTERM) 06:50:41.307967 --- ParallelTerminationStrategy: PID 4174 died... 06:50:41.327247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4174): Terminated: ok {rc=0} 06:50:41.371542 --- ParallelTerminationStrategy: PID 4177 died... 06:50:41.390154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4177): Terminated: ok {rc=0} 06:50:41.433956 --- ParallelTerminationStrategy: PID 4180 died... 06:50:41.452494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4180): Terminated: ok {rc=0} 06:50:41.535606 bus /sierra_3: Setting Powered False 06:50:42.631067 bus /sierra_3: Setting Powered False 06:50:43.747386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 06:50:44.995207 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:45.000137 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:50:45.058720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:50:45.084890 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:50:45.136540 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:50:45.198310 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:50:45.226330 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:50:45.773815 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 06:50:45.779608 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:45.790958 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:45.839606 tst handover.py: using LAC 19704 06:50:45.987190 tst handover.py: using RAC 69 06:50:46.109072 tst handover.py: using CellId 19704 06:50:46.254033 tst handover.py: using BVCI 19705 06:50:46.395481 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:50:46.446376 tst handover.py: using LAC 19705 06:50:46.609647 tst handover.py: using RAC 70 06:50:46.728353 tst handover.py: using CellId 19705 06:50:46.865664 tst handover.py: using BVCI 19706 06:50:46.988156 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.000762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.015301 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.027671 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.041259 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:50:47.055299 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:47.182314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:50:47.307372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:47.782807 run create_hlr_db(pid=4187): Launched 06:50:47.906405 bus /sierra_2: Setting Powered False 06:50:48.970136 run create_hlr_db(pid=4187): Terminated: ok {rc=0} 06:50:49.393446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Launched 06:50:49.718819 run osmo-hlr_10.42.42.2(pid=4190): Launched 06:50:49.842628 run osmo-stp_10.42.42.5: Starting osmo-stp 06:50:50.374303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Launched 06:50:50.698530 run osmo-stp_10.42.42.5(pid=4193): Launched 06:50:50.821442 run osmo-msc_10.42.42.6: Starting osmo-msc 06:50:51.376799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Launched 06:50:51.702320 run osmo-msc_10.42.42.6(pid=4196): Launched 06:50:51.882139 run osmo-stp_10.42.42.5(pid=4193): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] 06:50:52.018788 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-09_06:50:50.639315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:52.156038 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221209065050832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065050832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065050833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065050833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065050833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065050834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065050834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:52.292850 run osmo-stp_10.42.42.5(pid=4193): stdout: | (launched: 2022-12-09_06:50:50.639315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:50:52.422295 run osmo-stp_10.42.42.5(pid=4193): stderr: | 20221209065050832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065050832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065050833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065050833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065050833 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065050834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065050834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:50:52.577240 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 06:50:52.586219 tst handover.py:18: Test FAILED (6.8 sec) 06:50:52.614398 run osmo-hlr_10.42.42.2(pid=4190): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4190)] 06:50:52.664719 run osmo-hlr_10.42.42.2(pid=4190): stdout: | (launched: 2022-12-09_06:50:49.659860) 06:50:52.717305 run osmo-hlr_10.42.42.2(pid=4190): stderr: | 20221209065049859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065049860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065049860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065049860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065049860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065049860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065049872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065049880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065049880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065049880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:50:52.790351 run osmo-msc_10.42.42.6(pid=4196): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4196)] 06:50:52.840536 run osmo-msc_10.42.42.6(pid=4196): stdout: | (launched: 2022-12-09_06:50:51.643187) 06:50:52.892628 run osmo-msc_10.42.42.6(pid=4196): stderr: | 20221209065051965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065051966 DLGLOBAL DEBUG validating counter group 0x7f819b739c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065051966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065051966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065051966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065051966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065051968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065051968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065051968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065051968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:50:52.944924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminating (SIGTERM) 06:50:52.987161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminating (SIGTERM) 06:50:53.029251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Terminating (SIGTERM) 06:50:53.071628 --- ParallelTerminationStrategy: PID 4189 died... 06:50:53.091757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4189): Terminated: ok {rc=0} 06:50:53.138745 --- ParallelTerminationStrategy: PID 4192 died... 06:50:53.158464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4192): Terminated: ok {rc=0} 06:50:53.204920 --- ParallelTerminationStrategy: PID 4195 died... 06:50:53.224605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4195): Terminated: ok {rc=0} 06:50:53.311722 bus /sierra_3: Setting Powered False 06:50:54.410720 bus /sierra_3: Setting Powered False 06:50:55.523586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 06:50:56.797589 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:50:56.803270 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:50:56.863137 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:50:56.890375 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:50:56.943774 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:50:57.003251 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:50:57.030360 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:50:57.582720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 06:50:57.588075 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:57.599452 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:57.644485 tst handover.py: using LAC 19706 06:50:57.770916 tst handover.py: using RAC 71 06:50:57.900369 tst handover.py: using CellId 19706 06:50:58.027961 tst handover.py: using BVCI 19707 06:50:58.145969 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:50:58.193031 tst handover.py: using LAC 19707 06:50:58.318070 tst handover.py: using RAC 72 06:50:58.442940 tst handover.py: using CellId 19707 06:50:58.569823 tst handover.py: using BVCI 19708 06:50:58.687817 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.699298 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.710576 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.722167 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.733802 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:50:58.745267 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:58.862396 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:50:58.981466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:50:59.457777 run create_hlr_db(pid=4201): Launched 06:50:59.581986 bus /sierra_2: Setting Powered False 06:51:00.646041 run create_hlr_db(pid=4201): Terminated: ok {rc=0} 06:51:01.097956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4203): Launched 06:51:01.445687 run osmo-hlr_10.42.42.2(pid=4204): Launched 06:51:01.687726 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:02.305890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4206): Launched 06:51:02.636411 run osmo-stp_10.42.42.5(pid=4207): Launched 06:51:02.761013 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:03.318973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4209): Launched 06:51:03.644048 run osmo-msc_10.42.42.6(pid=4210): Launched 06:51:03.824666 run osmo-stp_10.42.42.5(pid=4207): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4207)] 06:51:03.961352 run osmo-stp_10.42.42.5(pid=4207): stdout: | (launched: 2022-12-09_06:51:02.577442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:04.099053 run osmo-stp_10.42.42.5(pid=4207): stderr: | 20221209065102772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065102772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065102772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065102773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065102773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065102773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065102773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:04.236029 run osmo-stp_10.42.42.5(pid=4207): stdout: | (launched: 2022-12-09_06:51:02.577442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:04.364777 run osmo-stp_10.42.42.5(pid=4207): stderr: | 20221209065102772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065102772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065102772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065102773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065102773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065102773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065102773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:04.519332 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4207): Process ended prematurely: osmo-stp_10.42.42.5(pid=4207) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4207)] [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 06:51:04.528022 tst handover.py:18: Test FAILED (6.9 sec) 06:51:04.556254 run osmo-hlr_10.42.42.2(pid=4204): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4204)] 06:51:04.606616 run osmo-hlr_10.42.42.2(pid=4204): stdout: | (launched: 2022-12-09_06:51:01.375435) 06:51:04.658739 run osmo-hlr_10.42.42.2(pid=4204): stderr: | 20221209065101690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065101690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065101690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065101690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065101690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065101690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065101701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065101710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065101710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065101710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:04.731318 run osmo-msc_10.42.42.6(pid=4210): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4210)] 06:51:04.781669 run osmo-msc_10.42.42.6(pid=4210): stdout: | (launched: 2022-12-09_06:51:03.585186) 06:51:04.833929 run osmo-msc_10.42.42.6(pid=4210): stderr: | 20221209065103909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065103909 DLGLOBAL DEBUG validating counter group 0x7f33f05b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065103909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065103909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065103909 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065103909 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065103911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065103911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065103912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065103912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:04.886618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4203): Terminating (SIGTERM) 06:51:04.928506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4206): Terminating (SIGTERM) 06:51:04.970645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4209): Terminating (SIGTERM) 06:51:05.013039 --- ParallelTerminationStrategy: PID 4203 died... 06:51:05.033150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4203): Terminated: ok {rc=0} 06:51:05.079806 --- ParallelTerminationStrategy: PID 4206 died... 06:51:05.099413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4206): Terminated: ok {rc=0} 06:51:05.145901 --- ParallelTerminationStrategy: PID 4209 died... 06:51:05.165524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4209): Terminated: ok {rc=0} 06:51:05.254221 bus /sierra_3: Setting Powered False 06:51:06.355927 bus /sierra_3: Setting Powered False 06:51:07.473206 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 06:51:08.738887 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:08.743878 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 06:51:08.794299 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 06:51:08.820491 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 06:51:08.871008 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 06:51:08.921477 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 06:51:08.947861 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 06:51:09.499924 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 06:51:09.504940 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:09.515952 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:51:09.564361 tst handover.py: using LAC 19708 06:51:09.682454 tst handover.py: using RAC 73 06:51:09.802057 tst handover.py: using CellId 19708 06:51:09.920435 tst handover.py: using BVCI 19709 06:51:10.031617 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 06:51:10.067176 tst handover.py: using LAC 19709 06:51:10.187400 tst handover.py: using RAC 74 06:51:10.307407 tst handover.py: using CellId 19709 06:51:10.426893 tst handover.py: using BVCI 19710 06:51:10.537815 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:10.548609 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:10.559329 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:10.569948 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:10.580737 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 06:51:10.591424 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:51:10.710374 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 06:51:10.827279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:11.272575 run create_hlr_db(pid=4216): Launched 06:51:11.395429 bus /sierra_2: Setting Powered False 06:51:12.455629 run create_hlr_db(pid=4216): Terminated: ok {rc=0} 06:51:12.852328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4218): Launched 06:51:13.156282 run osmo-hlr_10.42.42.2(pid=4219): Launched 06:51:13.270529 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:13.763864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4221): Launched 06:51:14.067129 run osmo-stp_10.42.42.5(pid=4222): Launched 06:51:14.192347 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:14.754308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4224): Launched 06:51:15.080019 run osmo-msc_10.42.42.6(pid=4225): Launched 06:51:15.263592 run osmo-stp_10.42.42.5(pid=4222): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4222)] 06:51:15.401684 run osmo-stp_10.42.42.5(pid=4222): stdout: | (launched: 2022-12-09_06:51:14.010901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:15.540506 run osmo-stp_10.42.42.5(pid=4222): stderr: | 20221209065114196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065114197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065114197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065114197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065114200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065114200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065114200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:15.677859 run osmo-stp_10.42.42.5(pid=4222): stdout: | (launched: 2022-12-09_06:51:14.010901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:15.807483 run osmo-stp_10.42.42.5(pid=4222): stderr: | 20221209065114196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065114197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065114197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065114197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065114200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065114200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065114200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:15.968310 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4222): Process ended prematurely: osmo-stp_10.42.42.5(pid=4222) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4222)] [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 06:51:15.978043 tst handover.py:18: Test FAILED (6.5 sec) 06:51:16.009270 run osmo-hlr_10.42.42.2(pid=4219): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4219)] 06:51:16.061878 run osmo-hlr_10.42.42.2(pid=4219): stdout: | (launched: 2022-12-09_06:51:13.100683) 06:51:16.116694 run osmo-hlr_10.42.42.2(pid=4219): stderr: | 20221209065113275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065113275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065113275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065113276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065113276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065113276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065113287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065113296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065113297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065113297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:16.192321 run osmo-msc_10.42.42.6(pid=4225): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4225)] 06:51:16.245347 run osmo-msc_10.42.42.6(pid=4225): stdout: | (launched: 2022-12-09_06:51:15.020801) 06:51:16.299928 run osmo-msc_10.42.42.6(pid=4225): stderr: | 20221209065115343 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065115344 DLGLOBAL DEBUG validating counter group 0x7f8fe40fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065115344 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065115344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065115344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065115344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065115346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065115346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065115346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065115346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:16.355415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4218): Terminating (SIGTERM) 06:51:16.400496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4221): Terminating (SIGTERM) 06:51:16.446882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4224): Terminating (SIGTERM) 06:51:16.494143 --- ParallelTerminationStrategy: PID 4218 died... 06:51:16.515148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4218): Terminated: ok {rc=0} 06:51:16.566409 --- ParallelTerminationStrategy: PID 4221 died... 06:51:16.587502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4221): Terminated: ok {rc=0} 06:51:16.637502 --- ParallelTerminationStrategy: PID 4224 died... 06:51:16.658272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4224): Terminated: ok {rc=0} 06:51:16.752024 bus /sierra_3: Setting Powered False 06:51:17.855149 bus /sierra_3: Setting Powered False 06:51:18.972668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 06:51:20.225887 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:20.231010 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:51:20.293583 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:51:20.320027 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:51:20.371011 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:51:20.436247 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:51:20.462262 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:51:21.011023 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 06:51:21.016059 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:21.026926 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:21.074417 tst handover.py: using LAC 19710 06:51:21.194515 tst handover.py: using RAC 75 06:51:21.313917 tst handover.py: using CellId 19710 06:51:21.432272 tst handover.py: using BVCI 19711 06:51:21.543217 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:21.591451 tst handover.py: using LAC 19711 06:51:21.711768 tst handover.py: using RAC 76 06:51:21.829850 tst handover.py: using CellId 19711 06:51:21.948035 tst handover.py: using BVCI 19712 06:51:22.066785 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:22.078601 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:22.090110 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:22.102388 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:22.114527 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:22.127038 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:22.244895 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:22.360709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:22.805765 run create_hlr_db(pid=4230): Launched 06:51:22.930098 bus /sierra_2: Setting Powered False 06:51:23.990846 run create_hlr_db(pid=4230): Terminated: ok {rc=0} 06:51:24.407679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4232): Launched 06:51:24.733686 run osmo-hlr_10.42.42.2(pid=4233): Launched 06:51:24.858530 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:25.389708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4235): Launched 06:51:25.715300 run osmo-stp_10.42.42.5(pid=4236): Launched 06:51:25.839265 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:26.398339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4238): Launched 06:51:26.724157 run osmo-msc_10.42.42.6(pid=4239): Launched 06:51:26.905280 run osmo-stp_10.42.42.5(pid=4236): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4236)] 06:51:27.042682 run osmo-stp_10.42.42.5(pid=4236): stdout: | (launched: 2022-12-09_06:51:25.656121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:27.180508 run osmo-stp_10.42.42.5(pid=4236): stderr: | 20221209065125846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065125846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065125846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065125847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065125847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065125847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065125847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:27.317814 run osmo-stp_10.42.42.5(pid=4236): stdout: | (launched: 2022-12-09_06:51:25.656121) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:27.447394 run osmo-stp_10.42.42.5(pid=4236): stderr: | 20221209065125846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065125846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065125846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065125847 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065125847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065125847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065125847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:27.602680 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4236): Process ended prematurely: osmo-stp_10.42.42.5(pid=4236) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4236)] [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 06:51:27.611530 tst handover.py:18: Test FAILED (6.6 sec) 06:51:27.639349 run osmo-hlr_10.42.42.2(pid=4233): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4233)] 06:51:27.690230 run osmo-hlr_10.42.42.2(pid=4233): stdout: | (launched: 2022-12-09_06:51:24.674805) 06:51:27.742856 run osmo-hlr_10.42.42.2(pid=4233): stderr: | 20221209065124872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065124872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065124872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065124872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065124872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065124872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065124885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065124893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065124893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065124893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:27.816002 run osmo-msc_10.42.42.6(pid=4239): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4239)] 06:51:27.866841 run osmo-msc_10.42.42.6(pid=4239): stdout: | (launched: 2022-12-09_06:51:26.664787) 06:51:27.919338 run osmo-msc_10.42.42.6(pid=4239): stderr: | 20221209065126986 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065126986 DLGLOBAL DEBUG validating counter group 0x7f2e6a2a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065126986 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065126986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065126986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065126987 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065126988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065126989 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065126989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065126989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:27.972281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4232): Terminating (SIGTERM) 06:51:28.014790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4235): Terminating (SIGTERM) 06:51:28.057176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4238): Terminating (SIGTERM) 06:51:28.099952 --- ParallelTerminationStrategy: PID 4232 died... 06:51:28.120188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4232): Terminated: ok {rc=0} 06:51:28.167497 --- ParallelTerminationStrategy: PID 4235 died... 06:51:28.187367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4235): Terminated: ok {rc=0} 06:51:28.234393 --- ParallelTerminationStrategy: PID 4238 died... 06:51:28.254183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4238): Terminated: ok {rc=0} 06:51:28.342305 bus /sierra_3: Setting Powered False 06:51:29.442186 bus /sierra_3: Setting Powered False 06:51:30.559596 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 06:51:31.875255 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:31.882206 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:51:31.952145 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:51:31.981959 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:51:32.044330 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:51:32.139049 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:51:32.170662 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:51:32.679968 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 06:51:32.686213 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:32.697865 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:32.749098 tst handover.py: using LAC 19712 06:51:32.882229 tst handover.py: using RAC 77 06:51:33.022739 tst handover.py: using CellId 19712 06:51:33.151622 tst handover.py: using BVCI 19713 06:51:33.270991 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:33.319980 tst handover.py: using LAC 19713 06:51:33.448717 tst handover.py: using RAC 78 06:51:33.575930 tst handover.py: using CellId 19713 06:51:33.704342 tst handover.py: using BVCI 19714 06:51:33.823870 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:33.835433 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:33.846852 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:33.858586 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:33.870372 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:33.882084 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:33.996876 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:34.112307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:34.556661 run create_hlr_db(pid=4244): Launched 06:51:34.681740 bus /sierra_2: Setting Powered False 06:51:35.742289 run create_hlr_db(pid=4244): Terminated: ok {rc=0} 06:51:36.156764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Launched 06:51:36.481095 run osmo-hlr_10.42.42.2(pid=4247): Launched 06:51:36.606591 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:37.139554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4249): Launched 06:51:37.463886 run osmo-stp_10.42.42.5(pid=4250): Launched 06:51:37.588412 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:38.145340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4252): Launched 06:51:38.471250 run osmo-msc_10.42.42.6(pid=4253): Launched 06:51:38.652270 run osmo-stp_10.42.42.5(pid=4250): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4250)] 06:51:38.788920 run osmo-stp_10.42.42.5(pid=4250): stdout: | (launched: 2022-12-09_06:51:37.404792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:38.926029 run osmo-stp_10.42.42.5(pid=4250): stderr: | 20221209065137597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065137598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065137598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065137598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065137600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065137601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065137601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:39.062216 run osmo-stp_10.42.42.5(pid=4250): stdout: | (launched: 2022-12-09_06:51:37.404792) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:39.192167 run osmo-stp_10.42.42.5(pid=4250): stderr: | 20221209065137597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065137598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065137598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065137598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065137600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065137601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065137601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:39.347058 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4250): Process ended prematurely: osmo-stp_10.42.42.5(pid=4250) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4250)] [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 06:51:39.355929 tst handover.py:18: Test FAILED (6.7 sec) 06:51:39.384055 run osmo-hlr_10.42.42.2(pid=4247): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4247)] 06:51:39.434474 run osmo-hlr_10.42.42.2(pid=4247): stdout: | (launched: 2022-12-09_06:51:36.422189) 06:51:39.486725 run osmo-hlr_10.42.42.2(pid=4247): stderr: | 20221209065136620 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065136620 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065136620 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065136620 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065136620 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065136621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065136632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065136640 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065136640 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065136640 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:39.559732 run osmo-msc_10.42.42.6(pid=4253): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4253)] 06:51:39.610115 run osmo-msc_10.42.42.6(pid=4253): stdout: | (launched: 2022-12-09_06:51:38.411280) 06:51:39.662255 run osmo-msc_10.42.42.6(pid=4253): stderr: | 20221209065138734 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065138735 DLGLOBAL DEBUG validating counter group 0x7f3fb1010c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065138735 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065138735 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065138735 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065138735 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065138737 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065138737 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065138737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065138737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:39.714828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Terminating (SIGTERM) 06:51:39.757083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4249): Terminating (SIGTERM) 06:51:39.799222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4252): Terminating (SIGTERM) 06:51:39.841820 --- ParallelTerminationStrategy: PID 4246 died... 06:51:39.861862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4246): Terminated: ok {rc=0} 06:51:39.908896 --- ParallelTerminationStrategy: PID 4249 died... 06:51:39.928652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4249): Terminated: ok {rc=0} 06:51:39.975803 --- ParallelTerminationStrategy: PID 4252 died... 06:51:39.995746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4252): Terminated: ok {rc=0} 06:51:40.083759 bus /sierra_3: Setting Powered False 06:51:41.182969 bus /sierra_3: Setting Powered False 06:51:42.299272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 06:51:43.572399 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:43.577565 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 06:51:43.627724 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 06:51:43.654172 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 06:51:43.705719 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 06:51:43.756216 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 06:51:43.782461 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 06:51:44.334324 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 06:51:44.339663 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:44.350645 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:44.384825 tst handover.py: using LAC 19714 06:51:44.508472 tst handover.py: using RAC 79 06:51:44.627835 tst handover.py: using CellId 19714 06:51:44.745408 tst handover.py: using BVCI 19715 06:51:44.856806 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 06:51:44.903642 tst handover.py: using LAC 19715 06:51:45.020328 tst handover.py: using RAC 80 06:51:45.137429 tst handover.py: using CellId 19715 06:51:45.264721 tst handover.py: using BVCI 19716 06:51:45.382306 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.393787 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.404757 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.416175 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.427700 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 06:51:45.438937 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:45.556064 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 06:51:45.671369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:46.195186 run create_hlr_db(pid=4258): Launched 06:51:46.344942 bus /sierra_2: Setting Powered False 06:51:47.404712 run create_hlr_db(pid=4258): Terminated: ok {rc=0} 06:51:47.821340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4260): Launched 06:51:48.146130 run osmo-hlr_10.42.42.2(pid=4261): Launched 06:51:48.269599 run osmo-stp_10.42.42.5: Starting osmo-stp 06:51:48.798898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4263): Launched 06:51:49.124862 run osmo-stp_10.42.42.5(pid=4264): Launched 06:51:49.250096 run osmo-msc_10.42.42.6: Starting osmo-msc 06:51:49.809103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4266): Launched 06:51:50.133715 run osmo-msc_10.42.42.6(pid=4267): Launched 06:51:50.314516 run osmo-stp_10.42.42.5(pid=4264): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4264)] 06:51:50.451915 run osmo-stp_10.42.42.5(pid=4264): stdout: | (launched: 2022-12-09_06:51:49.065616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:50.591587 run osmo-stp_10.42.42.5(pid=4264): stderr: | 20221209065149258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065149258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065149259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065149259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065149260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065149260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065149260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:50.729214 run osmo-stp_10.42.42.5(pid=4264): stdout: | (launched: 2022-12-09_06:51:49.065616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:51:50.858686 run osmo-stp_10.42.42.5(pid=4264): stderr: | 20221209065149258 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065149258 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065149259 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065149259 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065149260 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065149260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065149260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:51:51.013911 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4264): Process ended prematurely: osmo-stp_10.42.42.5(pid=4264) [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4264)] [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 06:51:51.022744 tst handover.py:18: Test FAILED (6.7 sec) 06:51:51.050546 run osmo-hlr_10.42.42.2(pid=4261): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4261)] 06:51:51.101449 run osmo-hlr_10.42.42.2(pid=4261): stdout: | (launched: 2022-12-09_06:51:48.087188) 06:51:51.153850 run osmo-hlr_10.42.42.2(pid=4261): stderr: | 20221209065148284 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065148284 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065148284 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065148284 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065148284 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065148284 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065148297 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065148305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065148305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065148305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:51:51.227172 run osmo-msc_10.42.42.6(pid=4267): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4267)] 06:51:51.278046 run osmo-msc_10.42.42.6(pid=4267): stdout: | (launched: 2022-12-09_06:51:50.074763) 06:51:51.330339 run osmo-msc_10.42.42.6(pid=4267): stderr: | 20221209065150395 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065150395 DLGLOBAL DEBUG validating counter group 0x7ff1c43d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065150395 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065150395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065150395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065150396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065150397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065150398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065150398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065150398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:51:51.382827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4260): Terminating (SIGTERM) 06:51:51.424685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4263): Terminating (SIGTERM) 06:51:51.466818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4266): Terminating (SIGTERM) 06:51:51.509285 --- ParallelTerminationStrategy: PID 4260 died... 06:51:51.529214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4260): Terminated: ok {rc=0} 06:51:51.575796 --- ParallelTerminationStrategy: PID 4263 died... 06:51:51.595488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4263): Terminated: ok {rc=0} 06:51:51.641796 --- ParallelTerminationStrategy: PID 4266 died... 06:51:51.661279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4266): Terminated: ok {rc=0} 06:51:51.749391 bus /sierra_3: Setting Powered False 06:51:52.848343 bus /sierra_3: Setting Powered False 06:51:53.965656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 06:51:55.218458 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:51:55.223674 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:51:55.273848 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:51:55.300255 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:51:55.356107 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:51:55.406140 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:51:55.432429 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:51:55.977882 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 06:51:55.983143 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:55.994125 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:56.028481 tst handover.py: using LAC 19716 06:51:56.146633 tst handover.py: using RAC 81 06:51:56.263585 tst handover.py: using CellId 19716 06:51:56.391031 tst handover.py: using BVCI 19717 06:51:56.510592 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:51:56.557751 tst handover.py: using LAC 19717 06:51:56.684902 tst handover.py: using RAC 82 06:51:56.813698 tst handover.py: using CellId 19717 06:51:56.939569 tst handover.py: using BVCI 19718 06:51:57.050243 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:57.061282 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:57.071996 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:57.082870 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:57.093897 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:51:57.104854 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:57.224301 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:51:57.342839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:51:57.785399 run create_hlr_db(pid=4272): Launched 06:51:57.912256 bus /sierra_2: Setting Powered False 06:51:58.977050 run create_hlr_db(pid=4272): Terminated: ok {rc=0} 06:51:59.401584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4274): Launched 06:51:59.725736 run osmo-hlr_10.42.42.2(pid=4275): Launched 06:51:59.848131 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:00.380513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4277): Launched 06:52:00.705491 run osmo-stp_10.42.42.5(pid=4278): Launched 06:52:00.830679 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:01.533899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4280): Launched 06:52:01.871688 run osmo-msc_10.42.42.6(pid=4281): Launched 06:52:02.328850 run osmo-stp_10.42.42.5(pid=4278): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4278)] 06:52:02.466208 run osmo-stp_10.42.42.5(pid=4278): stdout: | (launched: 2022-12-09_06:52:00.646411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:02.603697 run osmo-stp_10.42.42.5(pid=4278): stderr: | 20221209065200859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065200860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065200860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065200860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065200864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065200867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065200867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:02.739089 run osmo-stp_10.42.42.5(pid=4278): stdout: | (launched: 2022-12-09_06:52:00.646411) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:02.868072 run osmo-stp_10.42.42.5(pid=4278): stderr: | 20221209065200859 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065200860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065200860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065200860 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065200864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065200867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065200867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:03.022528 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4278): Process ended prematurely: osmo-stp_10.42.42.5(pid=4278) [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4278)] [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 06:52:03.031581 tst handover.py:18: Test FAILED (7.0 sec) 06:52:03.059849 run osmo-hlr_10.42.42.2(pid=4275): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4275)] 06:52:03.110600 run osmo-hlr_10.42.42.2(pid=4275): stdout: | (launched: 2022-12-09_06:51:59.667094) 06:52:03.162673 run osmo-hlr_10.42.42.2(pid=4275): stderr: | 20221209065159865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065159865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065159865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065159866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065159866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065159866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065159878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065159886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065159886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065159886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:03.235215 run osmo-msc_10.42.42.6(pid=4281): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4281)] 06:52:03.286097 run osmo-msc_10.42.42.6(pid=4281): stdout: | (launched: 2022-12-09_06:52:01.807439) 06:52:03.338822 run osmo-msc_10.42.42.6(pid=4281): stderr: | 20221209065202125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065202126 DLGLOBAL DEBUG validating counter group 0x7f665f110c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065202126 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065202126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065202126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065202126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065202129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065202130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065202130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065202130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:03.391479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4274): Terminating (SIGTERM) 06:52:03.433778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4277): Terminating (SIGTERM) 06:52:03.476233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4280): Terminating (SIGTERM) 06:52:03.519425 --- ParallelTerminationStrategy: PID 4274 died... 06:52:03.539938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4274): Terminated: ok {rc=0} 06:52:03.587588 --- ParallelTerminationStrategy: PID 4277 died... 06:52:03.607443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4277): Terminated: ok {rc=0} 06:52:03.654823 --- ParallelTerminationStrategy: PID 4280 died... 06:52:03.674862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4280): Terminated: ok {rc=0} 06:52:03.764053 bus /sierra_3: Setting Powered False 06:52:04.863931 bus /sierra_3: Setting Powered False 06:52:05.979567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2355 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 06:52:07.233514 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:52:07.238700 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 06:52:07.299558 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 06:52:07.326137 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 06:52:07.378435 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 06:52:07.440824 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 06:52:07.467129 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 06:52:08.019524 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2355 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 06:52:08.025303 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:08.036858 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:52:08.086672 tst handover.py: using LAC 19718 06:52:08.213155 tst handover.py: using RAC 83 06:52:08.340104 tst handover.py: using CellId 19718 06:52:08.466631 tst handover.py: using BVCI 19719 06:52:08.586263 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 06:52:08.635747 tst handover.py: using LAC 19719 06:52:08.755693 tst handover.py: using RAC 84 06:52:08.875754 tst handover.py: using CellId 19719 06:52:08.995733 tst handover.py: using BVCI 19720 06:52:09.106186 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:09.116926 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:09.127612 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:09.138284 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:09.148809 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 06:52:09.159382 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:52:09.279174 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 06:52:09.402318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:52:09.844535 run create_hlr_db(pid=4286): Launched 06:52:09.968338 bus /sierra_2: Setting Powered False 06:52:11.028677 run create_hlr_db(pid=4286): Terminated: ok {rc=0} 06:52:11.424836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4288): Launched 06:52:11.728918 run osmo-hlr_10.42.42.2(pid=4289): Launched 06:52:11.842797 run osmo-stp_10.42.42.5: Starting osmo-stp 06:52:12.349068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4291): Launched 06:52:12.651793 run osmo-stp_10.42.42.5(pid=4292): Launched 06:52:12.766403 run osmo-msc_10.42.42.6: Starting osmo-msc 06:52:13.286125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4294): Launched 06:52:13.588662 run osmo-msc_10.42.42.6(pid=4295): Launched 06:52:13.757247 run osmo-stp_10.42.42.5(pid=4292): ERR: Terminated: ERROR {rc=1} [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4292)] 06:52:13.885249 run osmo-stp_10.42.42.5(pid=4292): stdout: | (launched: 2022-12-09_06:52:12.596183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:14.013095 run osmo-stp_10.42.42.5(pid=4292): stderr: | 20221209065212768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065212768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065212769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065212769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065212769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065212769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065212770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:14.138570 run osmo-stp_10.42.42.5(pid=4292): stdout: | (launched: 2022-12-09_06:52:12.596183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:52:14.258280 run osmo-stp_10.42.42.5(pid=4292): stderr: | 20221209065212768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209065212768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209065212769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209065212769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209065212769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209065212769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209065212770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:52:14.401610 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=4292): Process ended prematurely: osmo-stp_10.42.42.5(pid=4292) [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4292)] [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 06:52:14.409742 tst handover.py:18: Test FAILED (6.4 sec) 06:52:14.435682 run osmo-hlr_10.42.42.2(pid=4289): ERR: Terminated: ERROR {rc=237} [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4289)] 06:52:14.483104 run osmo-hlr_10.42.42.2(pid=4289): stdout: | (launched: 2022-12-09_06:52:11.673471) 06:52:14.532520 run osmo-hlr_10.42.42.2(pid=4289): stderr: | 20221209065211852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209065211852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209065211852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209065211852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209065211852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209065211852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209065211863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209065211872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209065211872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209065211872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:52:14.601223 run osmo-msc_10.42.42.6(pid=4295): ERR: Terminated: ERROR {rc=2} [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4295)] 06:52:14.648888 run osmo-msc_10.42.42.6(pid=4295): stdout: | (launched: 2022-12-09_06:52:13.533234) 06:52:14.698137 run osmo-msc_10.42.42.6(pid=4295): stderr: | 20221209065213803 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209065213803 DLGLOBAL DEBUG validating counter group 0x7f48f510bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209065213803 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209065213803 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209065213803 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209065213803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209065213805 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209065213805 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209065213806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209065213806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:52:14.747935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4288): Terminating (SIGTERM) 06:52:14.787395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4291): Terminating (SIGTERM) 06:52:14.827309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4294): Terminating (SIGTERM) 06:52:14.867501 --- ParallelTerminationStrategy: PID 4288 died... 06:52:14.886748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4288): Terminated: ok {rc=0} 06:52:14.931089 --- ParallelTerminationStrategy: PID 4291 died... 06:52:14.949839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4291): Terminated: ok {rc=0} 06:52:14.993896 --- ParallelTerminationStrategy: PID 4294 died... 06:52:15.012615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4294): Terminated: ok {rc=0} 06:52:15.099073 bus /sierra_3: Setting Powered False 06:52:16.196573 bus /sierra_3: Setting Powered False 06:52:17.312135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2355 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 06:52:18.583253 tst trial-2355: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355/run.2022-12-09_05-28-02/trial-2355.xml -------------------------------------------------------------------------------------------- trial-2355 FAIL -------------------------------------------------------------------------------------------- 06:52:20.516191 tst trial-2355: trial-2355: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=28997): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28997) [trial-2355↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28997)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.1 sec) Error: osmo-stp_10.42.42.5(pid=29009): Process ended prematurely: osmo-stp_10.42.42.5(pid=29009) [trial-2355↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29009)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29018) [trial-2355↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29018)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29028): Process ended prematurely: osmo-stp_10.42.42.5(pid=29028) [trial-2355↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29028)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29042): Process ended prematurely: osmo-stp_10.42.42.5(pid=29042) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29042)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29067): Process ended prematurely: osmo-stp_10.42.42.5(pid=29067) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29067)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29078): Process ended prematurely: osmo-stp_10.42.42.5(pid=29078) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29078)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29092): Process ended prematurely: osmo-stp_10.42.42.5(pid=29092) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29103): Process ended prematurely: osmo-stp_10.42.42.5(pid=29103) [trial-2355↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29103)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29119): Process ended prematurely: osmo-stp_10.42.42.5(pid=29119) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29119)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29130): Process ended prematurely: osmo-stp_10.42.42.5(pid=29130) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29130)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29155): Process ended prematurely: osmo-stp_10.42.42.5(pid=29155) [trial-2355↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29155)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29170): Process ended prematurely: osmo-stp_10.42.42.5(pid=29170) [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29170)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29181): Process ended prematurely: osmo-stp_10.42.42.5(pid=29181) [trial-2355↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29181)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29196): Process ended prematurely: osmo-stp_10.42.42.5(pid=29196) [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29196)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29207): Process ended prematurely: osmo-stp_10.42.42.5(pid=29207) [trial-2355↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29207)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29221): Process ended prematurely: osmo-stp_10.42.42.5(pid=29221) [trial-2355↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29221)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29233): Process ended prematurely: osmo-stp_10.42.42.5(pid=29233) [trial-2355↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29233)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=29252): Process ended prematurely: osmo-stp_10.42.42.5(pid=29252) [trial-2355↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29252)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29264): Process ended prematurely: osmo-stp_10.42.42.5(pid=29264) [trial-2355↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29264)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29282): Process ended prematurely: osmo-stp_10.42.42.5(pid=29282) [trial-2355↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29282)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29292): Process ended prematurely: osmo-stp_10.42.42.5(pid=29292) [trial-2355↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29292)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29302): Process ended prematurely: osmo-stp_10.42.42.5(pid=29302) [trial-2355↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29302)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29324): Process ended prematurely: osmo-stp_10.42.42.5(pid=29324) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29324)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29336): Process ended prematurely: osmo-stp_10.42.42.5(pid=29336) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29336)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29354): Process ended prematurely: osmo-stp_10.42.42.5(pid=29354) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29354)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29364): Process ended prematurely: osmo-stp_10.42.42.5(pid=29364) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29364)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29374): Process ended prematurely: osmo-stp_10.42.42.5(pid=29374) [trial-2355↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29374)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=29391): Process ended prematurely: osmo-stp_10.42.42.5(pid=29391) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29391)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=29421): Process ended prematurely: osmo-stp_10.42.42.5(pid=29421) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29421)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29431): Process ended prematurely: osmo-stp_10.42.42.5(pid=29431) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29431)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29441): Process ended prematurely: osmo-stp_10.42.42.5(pid=29441) [trial-2355↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29441)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29458): Process ended prematurely: osmo-stp_10.42.42.5(pid=29458) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=29470): Process ended prematurely: osmo-stp_10.42.42.5(pid=29470) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29470)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=29488): Process ended prematurely: osmo-stp_10.42.42.5(pid=29488) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29488)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=29498): Process ended prematurely: osmo-stp_10.42.42.5(pid=29498) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29498)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29508): Process ended prematurely: osmo-stp_10.42.42.5(pid=29508) [trial-2355↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29508)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=29790): Process ended prematurely: osmo-stp_10.42.42.5(pid=29790) [trial-2355↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29790)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29805): Process ended prematurely: osmo-stp_10.42.42.5(pid=29805) [trial-2355↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29805)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29813): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29813) [trial-2355↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29813)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29823): Process ended prematurely: osmo-stp_10.42.42.5(pid=29823) [trial-2355↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29823)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29832): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29832) [trial-2355↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29832)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29843): Process ended prematurely: osmo-stp_10.42.42.5(pid=29843) [trial-2355↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29843)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29858): Process ended prematurely: osmo-stp_10.42.42.5(pid=29858) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29858)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29869): Process ended prematurely: osmo-stp_10.42.42.5(pid=29869) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29869)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29883): Process ended prematurely: osmo-stp_10.42.42.5(pid=29883) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29883)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29894): Process ended prematurely: osmo-stp_10.42.42.5(pid=29894) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29894)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29908): Process ended prematurely: osmo-stp_10.42.42.5(pid=29908) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29908)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29919): Process ended prematurely: osmo-stp_10.42.42.5(pid=29919) [trial-2355↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29919)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29937): Process ended prematurely: osmo-stp_10.42.42.5(pid=29937) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29937)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29948): Process ended prematurely: osmo-stp_10.42.42.5(pid=29948) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29948)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29962): Process ended prematurely: osmo-stp_10.42.42.5(pid=29962) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29962)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29973): Process ended prematurely: osmo-stp_10.42.42.5(pid=29973) [trial-2355↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29973)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29988): Process ended prematurely: osmo-stp_10.42.42.5(pid=29988) [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29988)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29999): Process ended prematurely: osmo-stp_10.42.42.5(pid=29999) [trial-2355↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29999)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30013): Process ended prematurely: osmo-stp_10.42.42.5(pid=30013) [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30013)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30024): Process ended prematurely: osmo-stp_10.42.42.5(pid=30024) [trial-2355↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30024)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30038): Process ended prematurely: osmo-stp_10.42.42.5(pid=30038) [trial-2355↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30049): Process ended prematurely: osmo-stp_10.42.42.5(pid=30049) [trial-2355↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30049)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=30071): Process ended prematurely: osmo-stp_10.42.42.5(pid=30071) [trial-2355↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30071)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2355↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30101): Process ended prematurely: osmo-stp_10.42.42.5(pid=30101) [trial-2355↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30101)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30111): Process ended prematurely: osmo-stp_10.42.42.5(pid=30111) [trial-2355↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30111)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2355↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30144): Process ended prematurely: osmo-stp_10.42.42.5(pid=30144) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30144)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=30156): Process ended prematurely: osmo-stp_10.42.42.5(pid=30156) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30156)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30174): Process ended prematurely: osmo-stp_10.42.42.5(pid=30174) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30174)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30184): Process ended prematurely: osmo-stp_10.42.42.5(pid=30184) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30184)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30194): Process ended prematurely: osmo-stp_10.42.42.5(pid=30194) [trial-2355↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30194)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30211): Process ended prematurely: osmo-stp_10.42.42.5(pid=30211) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30211)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30224): Process ended prematurely: osmo-stp_10.42.42.5(pid=30224) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30224)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30242): Process ended prematurely: osmo-stp_10.42.42.5(pid=30242) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30242)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30262): Process ended prematurely: osmo-stp_10.42.42.5(pid=30262) [trial-2355↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30280): Process ended prematurely: osmo-stp_10.42.42.5(pid=30280) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30280)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30302): Process ended prematurely: osmo-stp_10.42.42.5(pid=30302) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30302)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30846): Process ended prematurely: osmo-stp_10.42.42.5(pid=30846) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30846)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30858): Process ended prematurely: osmo-stp_10.42.42.5(pid=30858) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30858)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2355↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30883): Process ended prematurely: osmo-stp_10.42.42.5(pid=30883) [trial-2355↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30883)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30896): Process ended prematurely: osmo-stp_10.42.42.5(pid=30896) [trial-2355↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30896)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30904): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30904) [trial-2355↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30904)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30915): Process ended prematurely: osmo-stp_10.42.42.5(pid=30915) [trial-2355↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30915)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30924): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30924) [trial-2355↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30924)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30934): Process ended prematurely: osmo-stp_10.42.42.5(pid=30934) [trial-2355↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30934)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30948): Process ended prematurely: osmo-stp_10.42.42.5(pid=30948) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30948)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30959): Process ended prematurely: osmo-stp_10.42.42.5(pid=30959) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30959)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30973): Process ended prematurely: osmo-stp_10.42.42.5(pid=30973) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30973)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30984): Process ended prematurely: osmo-stp_10.42.42.5(pid=30984) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30984)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30998): Process ended prematurely: osmo-stp_10.42.42.5(pid=30998) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31009): Process ended prematurely: osmo-stp_10.42.42.5(pid=31009) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31023): Process ended prematurely: osmo-stp_10.42.42.5(pid=31023) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31023)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31034): Process ended prematurely: osmo-stp_10.42.42.5(pid=31034) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31034)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31048): Process ended prematurely: osmo-stp_10.42.42.5(pid=31048) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31048)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31059): Process ended prematurely: osmo-stp_10.42.42.5(pid=31059) [trial-2355↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31059)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31073): Process ended prematurely: osmo-stp_10.42.42.5(pid=31073) [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31073)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31084): Process ended prematurely: osmo-stp_10.42.42.5(pid=31084) [trial-2355↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31084)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31098): Process ended prematurely: osmo-stp_10.42.42.5(pid=31098) [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31098)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31109): Process ended prematurely: osmo-stp_10.42.42.5(pid=31109) [trial-2355↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31109)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31124): Process ended prematurely: osmo-stp_10.42.42.5(pid=31124) [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31124)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31135): Process ended prematurely: osmo-stp_10.42.42.5(pid=31135) [trial-2355↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31135)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31149): Process ended prematurely: osmo-stp_10.42.42.5(pid=31149) [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31149)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31160): Process ended prematurely: osmo-stp_10.42.42.5(pid=31160) [trial-2355↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31160)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31177): Process ended prematurely: osmo-stp_10.42.42.5(pid=31177) [trial-2355↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31177)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31188): Process ended prematurely: osmo-stp_10.42.42.5(pid=31188) [trial-2355↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=31206): Process ended prematurely: osmo-stp_10.42.42.5(pid=31206) [trial-2355↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31206)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31218): Process ended prematurely: osmo-stp_10.42.42.5(pid=31218) [trial-2355↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31218)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31236): Process ended prematurely: osmo-stp_10.42.42.5(pid=31236) [trial-2355↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31236)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2355↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31256): Process ended prematurely: osmo-stp_10.42.42.5(pid=31256) [trial-2355↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31256)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31273): Process ended prematurely: osmo-stp_10.42.42.5(pid=31273) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31273)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31285): Process ended prematurely: osmo-stp_10.42.42.5(pid=31285) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31285)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=31303): Process ended prematurely: osmo-stp_10.42.42.5(pid=31303) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31303)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31314): Process ended prematurely: osmo-stp_10.42.42.5(pid=31314) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31314)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31324): Process ended prematurely: osmo-stp_10.42.42.5(pid=31324) [trial-2355↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31324)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31343): Process ended prematurely: osmo-stp_10.42.42.5(pid=31343) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31343)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31355): Process ended prematurely: osmo-stp_10.42.42.5(pid=31355) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31355)] FAIL: iperf3m4.py (12.1 sec) Error: osmo-stp_10.42.42.5(pid=31642): Process ended prematurely: osmo-stp_10.42.42.5(pid=31642) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31655): Process ended prematurely: osmo-stp_10.42.42.5(pid=31655) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31655)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31665): Process ended prematurely: osmo-stp_10.42.42.5(pid=31665) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=31682): Process ended prematurely: osmo-stp_10.42.42.5(pid=31682) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31682)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31694): Process ended prematurely: osmo-stp_10.42.42.5(pid=31694) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31694)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=31712): Process ended prematurely: osmo-stp_10.42.42.5(pid=31712) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31712)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31733): Process ended prematurely: osmo-stp_10.42.42.5(pid=31733) [trial-2355↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31733)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=31751): Process ended prematurely: osmo-stp_10.42.42.5(pid=31751) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31751)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31763): Process ended prematurely: osmo-stp_10.42.42.5(pid=31763) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31763)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=31784): Process ended prematurely: osmo-stp_10.42.42.5(pid=31784) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31784)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31794): Process ended prematurely: osmo-stp_10.42.42.5(pid=31794) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31794)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31804): Process ended prematurely: osmo-stp_10.42.42.5(pid=31804) [trial-2355↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31804)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31819): Process ended prematurely: osmo-stp_10.42.42.5(pid=31819) [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31832): Process ended prematurely: osmo-stp_10.42.42.5(pid=31832) [trial-2355↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31832)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31840): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31840) [trial-2355↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31840)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31851): Process ended prematurely: osmo-stp_10.42.42.5(pid=31851) [trial-2355↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31851)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=31860): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31860) [trial-2355↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31860)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=31870): Process ended prematurely: osmo-stp_10.42.42.5(pid=31870) [trial-2355↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31870)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31884): Process ended prematurely: osmo-stp_10.42.42.5(pid=31884) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31884)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31895): Process ended prematurely: osmo-stp_10.42.42.5(pid=31895) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31895)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31909): Process ended prematurely: osmo-stp_10.42.42.5(pid=31909) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31909)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31920): Process ended prematurely: osmo-stp_10.42.42.5(pid=31920) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31920)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31934): Process ended prematurely: osmo-stp_10.42.42.5(pid=31934) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31934)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31945): Process ended prematurely: osmo-stp_10.42.42.5(pid=31945) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31961): Process ended prematurely: osmo-stp_10.42.42.5(pid=31961) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31961)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31972): Process ended prematurely: osmo-stp_10.42.42.5(pid=31972) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31986): Process ended prematurely: osmo-stp_10.42.42.5(pid=31986) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31986)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31997): Process ended prematurely: osmo-stp_10.42.42.5(pid=31997) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31997)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32011): Process ended prematurely: osmo-stp_10.42.42.5(pid=32011) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32011)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32037): Process ended prematurely: osmo-stp_10.42.42.5(pid=32037) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32037)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32048): Process ended prematurely: osmo-stp_10.42.42.5(pid=32048) [trial-2355↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32048)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32062): Process ended prematurely: osmo-stp_10.42.42.5(pid=32062) [trial-2355↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32062)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32073): Process ended prematurely: osmo-stp_10.42.42.5(pid=32073) [trial-2355↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32073)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=32091): Process ended prematurely: osmo-stp_10.42.42.5(pid=32091) [trial-2355↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32091)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32104): Process ended prematurely: osmo-stp_10.42.42.5(pid=32104) [trial-2355↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32104)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=32122): Process ended prematurely: osmo-stp_10.42.42.5(pid=32122) [trial-2355↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32122)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32177): Process ended prematurely: osmo-stp_10.42.42.5(pid=32177) [trial-2355↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32177)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32187): Process ended prematurely: osmo-stp_10.42.42.5(pid=32187) [trial-2355↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32187)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=32205): Process ended prematurely: osmo-stp_10.42.42.5(pid=32205) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32205)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32217): Process ended prematurely: osmo-stp_10.42.42.5(pid=32217) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=32235): Process ended prematurely: osmo-stp_10.42.42.5(pid=32235) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32235)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32245): Process ended prematurely: osmo-stp_10.42.42.5(pid=32245) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32245)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32255): Process ended prematurely: osmo-stp_10.42.42.5(pid=32255) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32255)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=32273): Process ended prematurely: osmo-stp_10.42.42.5(pid=32273) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32273)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32285): Process ended prematurely: osmo-stp_10.42.42.5(pid=32285) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32285)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32303): Process ended prematurely: osmo-stp_10.42.42.5(pid=32303) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32313): Process ended prematurely: osmo-stp_10.42.42.5(pid=32313) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32313)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32323): Process ended prematurely: osmo-stp_10.42.42.5(pid=32323) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32323)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=32342): Process ended prematurely: osmo-stp_10.42.42.5(pid=32342) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32342)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32354): Process ended prematurely: osmo-stp_10.42.42.5(pid=32354) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32354)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32372): Process ended prematurely: osmo-stp_10.42.42.5(pid=32372) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32372)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32396): Process ended prematurely: osmo-stp_10.42.42.5(pid=32396) [trial-2355↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32396)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32409): Process ended prematurely: osmo-stp_10.42.42.5(pid=32409) [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32409)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32422): Process ended prematurely: osmo-stp_10.42.42.5(pid=32422) [trial-2355↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32422)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=32430): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32430) [trial-2355↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32430)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=32440): Process ended prematurely: osmo-stp_10.42.42.5(pid=32440) [trial-2355↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32440)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32449): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32449) [trial-2355↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32449)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32459): Process ended prematurely: osmo-stp_10.42.42.5(pid=32459) [trial-2355↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32459)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32473): Process ended prematurely: osmo-stp_10.42.42.5(pid=32473) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32473)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32484): Process ended prematurely: osmo-stp_10.42.42.5(pid=32484) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32484)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32498): Process ended prematurely: osmo-stp_10.42.42.5(pid=32498) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32498)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32510): Process ended prematurely: osmo-stp_10.42.42.5(pid=32510) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32510)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32527): Process ended prematurely: osmo-stp_10.42.42.5(pid=32527) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32527)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32538): Process ended prematurely: osmo-stp_10.42.42.5(pid=32538) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32538)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32552): Process ended prematurely: osmo-stp_10.42.42.5(pid=32552) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32552)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32563): Process ended prematurely: osmo-stp_10.42.42.5(pid=32563) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32563)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32577): Process ended prematurely: osmo-stp_10.42.42.5(pid=32577) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32577)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32588): Process ended prematurely: osmo-stp_10.42.42.5(pid=32588) [trial-2355↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32588)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32602): Process ended prematurely: osmo-stp_10.42.42.5(pid=32602) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32602)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32613): Process ended prematurely: osmo-stp_10.42.42.5(pid=32613) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32613)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32627): Process ended prematurely: osmo-stp_10.42.42.5(pid=32627) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32627)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32639): Process ended prematurely: osmo-stp_10.42.42.5(pid=32639) [trial-2355↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32639)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32653): Process ended prematurely: osmo-stp_10.42.42.5(pid=32653) [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32653)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32664): Process ended prematurely: osmo-stp_10.42.42.5(pid=32664) [trial-2355↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32664)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32679): Process ended prematurely: osmo-stp_10.42.42.5(pid=32679) [trial-2355↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32679)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32690): Process ended prematurely: osmo-stp_10.42.42.5(pid=32690) [trial-2355↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32690)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32710): Process ended prematurely: osmo-stp_10.42.42.5(pid=32710) [trial-2355↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32710)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32722): Process ended prematurely: osmo-stp_10.42.42.5(pid=32722) [trial-2355↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32722)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2355↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=568): Process ended prematurely: osmo-stp_10.42.42.5(pid=568) [trial-2355↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=568)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=578): Process ended prematurely: osmo-stp_10.42.42.5(pid=578) [trial-2355↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=578)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=596): Process ended prematurely: osmo-stp_10.42.42.5(pid=596) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=596)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=608): Process ended prematurely: osmo-stp_10.42.42.5(pid=608) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=608)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=626): Process ended prematurely: osmo-stp_10.42.42.5(pid=626) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=626)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=636): Process ended prematurely: osmo-stp_10.42.42.5(pid=636) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=636)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=646): Process ended prematurely: osmo-stp_10.42.42.5(pid=646) [trial-2355↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=646)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=663): Process ended prematurely: osmo-stp_10.42.42.5(pid=663) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=663)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=676): Process ended prematurely: osmo-stp_10.42.42.5(pid=676) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=676)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=697): Process ended prematurely: osmo-stp_10.42.42.5(pid=697) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=697)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=708): Process ended prematurely: osmo-stp_10.42.42.5(pid=708) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=708)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=719): Process ended prematurely: osmo-stp_10.42.42.5(pid=719) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=719)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=736): Process ended prematurely: osmo-stp_10.42.42.5(pid=736) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=748): Process ended prematurely: osmo-stp_10.42.42.5(pid=748) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=748)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=766): Process ended prematurely: osmo-stp_10.42.42.5(pid=766) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=766)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=776): Process ended prematurely: osmo-stp_10.42.42.5(pid=776) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=776)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=786): Process ended prematurely: osmo-stp_10.42.42.5(pid=786) [trial-2355↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=786)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=803): Process ended prematurely: osmo-stp_10.42.42.5(pid=803) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=803)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=815): Process ended prematurely: osmo-stp_10.42.42.5(pid=815) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=815)] FAIL: iperf3m4.py (10.1 sec) Error: osmo-stp_10.42.42.5(pid=838): Process ended prematurely: osmo-stp_10.42.42.5(pid=838) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=849): Process ended prematurely: osmo-stp_10.42.42.5(pid=849) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=849)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=859): Process ended prematurely: osmo-stp_10.42.42.5(pid=859) [trial-2355↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=859)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=888): Process ended prematurely: osmo-stp_10.42.42.5(pid=888) [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=888)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=901): Process ended prematurely: osmo-stp_10.42.42.5(pid=901) [trial-2355↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=901)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=909): Process ended prematurely: osmo-nitb_10.42.42.2(pid=909) [trial-2355↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=909)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=920): Process ended prematurely: osmo-stp_10.42.42.5(pid=920) [trial-2355↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=920)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=929): Process ended prematurely: osmo-nitb_10.42.42.2(pid=929) [trial-2355↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=929)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=940): Process ended prematurely: osmo-stp_10.42.42.5(pid=940) [trial-2355↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=940)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=955): Process ended prematurely: osmo-stp_10.42.42.5(pid=955) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=967): Process ended prematurely: osmo-stp_10.42.42.5(pid=967) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=967)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=981): Process ended prematurely: osmo-stp_10.42.42.5(pid=981) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=981)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=997): Process ended prematurely: osmo-stp_10.42.42.5(pid=997) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=997)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1022): Process ended prematurely: osmo-stp_10.42.42.5(pid=1022) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1022)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=1038): Process ended prematurely: osmo-stp_10.42.42.5(pid=1038) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1038)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1049): Process ended prematurely: osmo-stp_10.42.42.5(pid=1049) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1049)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1066): Process ended prematurely: osmo-stp_10.42.42.5(pid=1066) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1066)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1077): Process ended prematurely: osmo-stp_10.42.42.5(pid=1077) [trial-2355↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1077)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1092): Process ended prematurely: osmo-stp_10.42.42.5(pid=1092) [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1092)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1103): Process ended prematurely: osmo-stp_10.42.42.5(pid=1103) [trial-2355↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1103)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1118): Process ended prematurely: osmo-stp_10.42.42.5(pid=1118) [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1118)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2355↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1154): Process ended prematurely: osmo-stp_10.42.42.5(pid=1154) [trial-2355↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1154)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1165): Process ended prematurely: osmo-stp_10.42.42.5(pid=1165) [trial-2355↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1165)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=1186): Process ended prematurely: osmo-stp_10.42.42.5(pid=1186) [trial-2355↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1186)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1198): Process ended prematurely: osmo-stp_10.42.42.5(pid=1198) [trial-2355↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1198)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=1216): Process ended prematurely: osmo-stp_10.42.42.5(pid=1216) [trial-2355↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1216)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1229): Process ended prematurely: osmo-stp_10.42.42.5(pid=1229) [trial-2355↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1229)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1240): Process ended prematurely: osmo-stp_10.42.42.5(pid=1240) [trial-2355↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1240)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=1258): Process ended prematurely: osmo-stp_10.42.42.5(pid=1258) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1258)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=1273): Process ended prematurely: osmo-stp_10.42.42.5(pid=1273) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1273)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1291): Process ended prematurely: osmo-stp_10.42.42.5(pid=1291) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1291)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1311): Process ended prematurely: osmo-stp_10.42.42.5(pid=1311) [trial-2355↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1311)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1328): Process ended prematurely: osmo-stp_10.42.42.5(pid=1328) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1328)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1340): Process ended prematurely: osmo-stp_10.42.42.5(pid=1340) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1368): Process ended prematurely: osmo-stp_10.42.42.5(pid=1368) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1379): Process ended prematurely: osmo-stp_10.42.42.5(pid=1379) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1379)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1396): Process ended prematurely: osmo-stp_10.42.42.5(pid=1396) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1396)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1408): Process ended prematurely: osmo-stp_10.42.42.5(pid=1408) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1408)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=1426): Process ended prematurely: osmo-stp_10.42.42.5(pid=1426) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1439): Process ended prematurely: osmo-stp_10.42.42.5(pid=1439) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1439)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1449): Process ended prematurely: osmo-stp_10.42.42.5(pid=1449) [trial-2355↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1449)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1463): Process ended prematurely: osmo-stp_10.42.42.5(pid=1463) [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1463)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1476): Process ended prematurely: osmo-stp_10.42.42.5(pid=1476) [trial-2355↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1476)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1485): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1485) [trial-2355↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1485)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=1495): Process ended prematurely: osmo-stp_10.42.42.5(pid=1495) [trial-2355↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1495)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=1504): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1504) [trial-2355↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1504)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1514): Process ended prematurely: osmo-stp_10.42.42.5(pid=1514) [trial-2355↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1528): Process ended prematurely: osmo-stp_10.42.42.5(pid=1528) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1528)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1539): Process ended prematurely: osmo-stp_10.42.42.5(pid=1539) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1539)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1553): Process ended prematurely: osmo-stp_10.42.42.5(pid=1553) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1553)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1564): Process ended prematurely: osmo-stp_10.42.42.5(pid=1564) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1564)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1578): Process ended prematurely: osmo-stp_10.42.42.5(pid=1578) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1578)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1603): Process ended prematurely: osmo-stp_10.42.42.5(pid=1603) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1603)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1615): Process ended prematurely: osmo-stp_10.42.42.5(pid=1615) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1615)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1630): Process ended prematurely: osmo-stp_10.42.42.5(pid=1630) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1630)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1642): Process ended prematurely: osmo-stp_10.42.42.5(pid=1642) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1642)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=1932): Process ended prematurely: osmo-stp_10.42.42.5(pid=1932) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1932)] FAIL: mo_mt_call_osmux.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1943): Process ended prematurely: osmo-stp_10.42.42.5(pid=1943) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1943)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1958): Process ended prematurely: osmo-stp_10.42.42.5(pid=1958) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1958)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1970): Process ended prematurely: osmo-stp_10.42.42.5(pid=1970) [trial-2355↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1984): Process ended prematurely: osmo-stp_10.42.42.5(pid=1984) [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1984)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2355↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2355↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2043): Process ended prematurely: osmo-stp_10.42.42.5(pid=2043) [trial-2355↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2056): Process ended prematurely: osmo-stp_10.42.42.5(pid=2056) [trial-2355↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2056)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2066): Process ended prematurely: osmo-stp_10.42.42.5(pid=2066) [trial-2355↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2066)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=2084): Process ended prematurely: osmo-stp_10.42.42.5(pid=2084) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2084)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2096): Process ended prematurely: osmo-stp_10.42.42.5(pid=2096) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2096)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2114): Process ended prematurely: osmo-stp_10.42.42.5(pid=2114) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2114)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2124): Process ended prematurely: osmo-stp_10.42.42.5(pid=2124) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2124)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2134): Process ended prematurely: osmo-stp_10.42.42.5(pid=2134) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2134)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=2151): Process ended prematurely: osmo-stp_10.42.42.5(pid=2151) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2151)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2163): Process ended prematurely: osmo-stp_10.42.42.5(pid=2163) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2163)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2181): Process ended prematurely: osmo-stp_10.42.42.5(pid=2181) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2181)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2193): Process ended prematurely: osmo-stp_10.42.42.5(pid=2193) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2193)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2203): Process ended prematurely: osmo-stp_10.42.42.5(pid=2203) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2203)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=2220): Process ended prematurely: osmo-stp_10.42.42.5(pid=2220) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2220)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2232): Process ended prematurely: osmo-stp_10.42.42.5(pid=2232) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2232)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=2251): Process ended prematurely: osmo-stp_10.42.42.5(pid=2251) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2251)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2261): Process ended prematurely: osmo-stp_10.42.42.5(pid=2261) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2261)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2271): Process ended prematurely: osmo-stp_10.42.42.5(pid=2271) [trial-2355↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2271)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2284): Process ended prematurely: osmo-stp_10.42.42.5(pid=2284) [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2284)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2297): Process ended prematurely: osmo-stp_10.42.42.5(pid=2297) [trial-2355↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2297)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2309) [trial-2355↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2309)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2319): Process ended prematurely: osmo-stp_10.42.42.5(pid=2319) [trial-2355↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2319)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2328): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2328) [trial-2355↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2328)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=2338): Process ended prematurely: osmo-stp_10.42.42.5(pid=2338) [trial-2355↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2338)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2352): Process ended prematurely: osmo-stp_10.42.42.5(pid=2352) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2352)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2363): Process ended prematurely: osmo-stp_10.42.42.5(pid=2363) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2363)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2377): Process ended prematurely: osmo-stp_10.42.42.5(pid=2377) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2377)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2388): Process ended prematurely: osmo-stp_10.42.42.5(pid=2388) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2388)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2402): Process ended prematurely: osmo-stp_10.42.42.5(pid=2402) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2402)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2416): Process ended prematurely: osmo-stp_10.42.42.5(pid=2416) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2416)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2430): Process ended prematurely: osmo-stp_10.42.42.5(pid=2430) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2430)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2441): Process ended prematurely: osmo-stp_10.42.42.5(pid=2441) [trial-2355↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2441)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2455): Process ended prematurely: osmo-stp_10.42.42.5(pid=2455) [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2455)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2466): Process ended prematurely: osmo-stp_10.42.42.5(pid=2466) [trial-2355↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2466)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2482): Process ended prematurely: osmo-stp_10.42.42.5(pid=2482) [trial-2355↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2482)] FAIL: emergency_preemptive_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2493): Process ended prematurely: osmo-stp_10.42.42.5(pid=2493) [trial-2355↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2493)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=2511): Process ended prematurely: osmo-stp_10.42.42.5(pid=2511) [trial-2355↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2523): Process ended prematurely: osmo-stp_10.42.42.5(pid=2523) [trial-2355↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2523)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2541): Process ended prematurely: osmo-stp_10.42.42.5(pid=2541) [trial-2355↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2551): Process ended prematurely: osmo-stp_10.42.42.5(pid=2551) [trial-2355↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2551)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2561): Process ended prematurely: osmo-stp_10.42.42.5(pid=2561) [trial-2355↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2561)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=2579): Process ended prematurely: osmo-stp_10.42.42.5(pid=2579) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2579)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=2596): Process ended prematurely: osmo-stp_10.42.42.5(pid=2596) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2596)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2614): Process ended prematurely: osmo-stp_10.42.42.5(pid=2614) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2614)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2625): Process ended prematurely: osmo-stp_10.42.42.5(pid=2625) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2625)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2635): Process ended prematurely: osmo-stp_10.42.42.5(pid=2635) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2635)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=2652): Process ended prematurely: osmo-stp_10.42.42.5(pid=2652) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2652)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=2664): Process ended prematurely: osmo-stp_10.42.42.5(pid=2664) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2664)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2683): Process ended prematurely: osmo-stp_10.42.42.5(pid=2683) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2683)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2693): Process ended prematurely: osmo-stp_10.42.42.5(pid=2693) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2693)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2703): Process ended prematurely: osmo-stp_10.42.42.5(pid=2703) [trial-2355↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2703)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2716): Process ended prematurely: osmo-stp_10.42.42.5(pid=2716) [trial-2355↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2716)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2729): Process ended prematurely: osmo-stp_10.42.42.5(pid=2729) [trial-2355↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=2739): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2739) [trial-2355↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2739)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2749): Process ended prematurely: osmo-stp_10.42.42.5(pid=2749) [trial-2355↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2749)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2763): Process ended prematurely: osmo-stp_10.42.42.5(pid=2763) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2763)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2777): Process ended prematurely: osmo-stp_10.42.42.5(pid=2777) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2777)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2791): Process ended prematurely: osmo-stp_10.42.42.5(pid=2791) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2791)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2802): Process ended prematurely: osmo-stp_10.42.42.5(pid=2802) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2802)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2817): Process ended prematurely: osmo-stp_10.42.42.5(pid=2817) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2817)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2828): Process ended prematurely: osmo-stp_10.42.42.5(pid=2828) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2828)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2842): Process ended prematurely: osmo-stp_10.42.42.5(pid=2842) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2842)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2853): Process ended prematurely: osmo-stp_10.42.42.5(pid=2853) [trial-2355↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2853)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=2867): Process ended prematurely: osmo-stp_10.42.42.5(pid=2867) [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2867)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2878): Process ended prematurely: osmo-stp_10.42.42.5(pid=2878) [trial-2355↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2878)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2892): Process ended prematurely: osmo-stp_10.42.42.5(pid=2892) [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2892)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2903): Process ended prematurely: osmo-stp_10.42.42.5(pid=2903) [trial-2355↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2903)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2919): Process ended prematurely: osmo-stp_10.42.42.5(pid=2919) [trial-2355↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2930): Process ended prematurely: osmo-stp_10.42.42.5(pid=2930) [trial-2355↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2930)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=2948): Process ended prematurely: osmo-stp_10.42.42.5(pid=2948) [trial-2355↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2948)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2355↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=2981): Process ended prematurely: osmo-stp_10.42.42.5(pid=2981) [trial-2355↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2981)] FAIL: ping.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3311): Process ended prematurely: osmo-stp_10.42.42.5(pid=3311) [trial-2355↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3311)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3321): Process ended prematurely: osmo-stp_10.42.42.5(pid=3321) [trial-2355↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3321)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=3338): Process ended prematurely: osmo-stp_10.42.42.5(pid=3338) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3338)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=3351): Process ended prematurely: osmo-stp_10.42.42.5(pid=3351) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3351)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=3370): Process ended prematurely: osmo-stp_10.42.42.5(pid=3370) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3370)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3380): Process ended prematurely: osmo-stp_10.42.42.5(pid=3380) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3380)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3390): Process ended prematurely: osmo-stp_10.42.42.5(pid=3390) [trial-2355↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3390)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=3408): Process ended prematurely: osmo-stp_10.42.42.5(pid=3408) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3408)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=3420): Process ended prematurely: osmo-stp_10.42.42.5(pid=3420) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3420)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=3438): Process ended prematurely: osmo-stp_10.42.42.5(pid=3438) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3438)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3451): Process ended prematurely: osmo-stp_10.42.42.5(pid=3451) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3451)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3461): Process ended prematurely: osmo-stp_10.42.42.5(pid=3461) [trial-2355↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3461)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3479): Process ended prematurely: osmo-stp_10.42.42.5(pid=3479) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3479)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3491): Process ended prematurely: osmo-stp_10.42.42.5(pid=3491) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3491)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=3509): Process ended prematurely: osmo-stp_10.42.42.5(pid=3509) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3509)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3519): Process ended prematurely: osmo-stp_10.42.42.5(pid=3519) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3519)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3529): Process ended prematurely: osmo-stp_10.42.42.5(pid=3529) [trial-2355↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3529)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3542): Process ended prematurely: osmo-stp_10.42.42.5(pid=3542) [trial-2355↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3542)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=3550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3550) [trial-2355↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3550)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=3552): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3552) [trial-2355↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3552)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=3554): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3554) [trial-2355↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3554)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3556): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3556) [trial-2355↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3556)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=3565): Process ended prematurely: osmo-hlr_10.42.42.2(pid=3565) [trial-2355↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3565)] FAIL: esme_connect_policy_closed.py (6.1 sec) Error: osmo-hlr_10.42.42.2(pid=3586): Process ended prematurely: osmo-hlr_10.42.42.2(pid=3586) [trial-2355↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3586)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3598): Process ended prematurely: osmo-stp_10.42.42.5(pid=3598) [trial-2355↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3598)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3609): Process ended prematurely: osmo-stp_10.42.42.5(pid=3609) [trial-2355↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3609)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3623): Process ended prematurely: osmo-stp_10.42.42.5(pid=3623) [trial-2355↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3623)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3634): Process ended prematurely: osmo-stp_10.42.42.5(pid=3634) [trial-2355↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3634)] FAIL: register_a5_1_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3645): Process ended prematurely: osmo-stp_10.42.42.5(pid=3645) [trial-2355↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3645)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3656): Process ended prematurely: osmo-stp_10.42.42.5(pid=3656) [trial-2355↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3656)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=3676): Process ended prematurely: srsepc(pid=3676) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3676)] FAIL: iperf3_bidir.py (18.8 sec) Error: srsepc(pid=3692): Process ended prematurely: srsepc(pid=3692) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3692)] FAIL: iperf3_dl.py (18.6 sec) Error: srsepc(pid=3708): Process ended prematurely: srsepc(pid=3708) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3708)] FAIL: iperf3_ul.py (18.6 sec) Error: srsepc(pid=3725): Process ended prematurely: srsepc(pid=3725) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3725)] FAIL: ping.py (18.2 sec) Error: srsepc(pid=3741): Process ended prematurely: srsepc(pid=3741) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3741)] FAIL: rrc_idle_mo_ping.py (18.4 sec) Error: srsepc(pid=3757): Process ended prematurely: srsepc(pid=3757) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3757)] FAIL: rrc_idle_mt_ping.py (18.7 sec) Error: srsepc(pid=3776): Process ended prematurely: srsepc(pid=3776) [trial-2355↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=3776)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3792): Process ended prematurely: osmo-stp_10.42.42.5(pid=3792) [trial-2355↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3792)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3807): Process ended prematurely: osmo-stp_10.42.42.5(pid=3807) [trial-2355↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3807)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3821): Process ended prematurely: osmo-stp_10.42.42.5(pid=3821) [trial-2355↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3821)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3835): Process ended prematurely: osmo-stp_10.42.42.5(pid=3835) [trial-2355↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3835)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3849): Process ended prematurely: osmo-stp_10.42.42.5(pid=3849) [trial-2355↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3849)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2355↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3877): Process ended prematurely: osmo-stp_10.42.42.5(pid=3877) [trial-2355↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3877)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3891): Process ended prematurely: osmo-stp_10.42.42.5(pid=3891) [trial-2355↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3891)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3905): Process ended prematurely: osmo-stp_10.42.42.5(pid=3905) [trial-2355↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3919): Process ended prematurely: osmo-stp_10.42.42.5(pid=3919) [trial-2355↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3919)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3933): Process ended prematurely: osmo-stp_10.42.42.5(pid=3933) [trial-2355↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3933)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3947): Process ended prematurely: osmo-stp_10.42.42.5(pid=3947) [trial-2355↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3947)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3962): Process ended prematurely: osmo-stp_10.42.42.5(pid=3962) [trial-2355↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3976): Process ended prematurely: osmo-stp_10.42.42.5(pid=3976) [trial-2355↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3976)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3990): Process ended prematurely: osmo-stp_10.42.42.5(pid=3990) [trial-2355↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3990)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4004): Process ended prematurely: osmo-stp_10.42.42.5(pid=4004) [trial-2355↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4004)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4018): Process ended prematurely: osmo-stp_10.42.42.5(pid=4018) [trial-2355↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4018)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2355↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4047): Process ended prematurely: osmo-stp_10.42.42.5(pid=4047) [trial-2355↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4061): Process ended prematurely: osmo-stp_10.42.42.5(pid=4061) [trial-2355↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4061)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4075): Process ended prematurely: osmo-stp_10.42.42.5(pid=4075) [trial-2355↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4075)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4090): Process ended prematurely: osmo-stp_10.42.42.5(pid=4090) [trial-2355↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4090)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4104): Process ended prematurely: osmo-stp_10.42.42.5(pid=4104) [trial-2355↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4104)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4118): Process ended prematurely: osmo-stp_10.42.42.5(pid=4118) [trial-2355↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4118)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4135): Process ended prematurely: osmo-stp_10.42.42.5(pid=4135) [trial-2355↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4135)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4149): Process ended prematurely: osmo-stp_10.42.42.5(pid=4149) [trial-2355↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4149)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4164): Process ended prematurely: osmo-stp_10.42.42.5(pid=4164) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4164)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4178): Process ended prematurely: osmo-stp_10.42.42.5(pid=4178) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4178)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4193): Process ended prematurely: osmo-stp_10.42.42.5(pid=4193) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4193)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4207): Process ended prematurely: osmo-stp_10.42.42.5(pid=4207) [trial-2355↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4207)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4222): Process ended prematurely: osmo-stp_10.42.42.5(pid=4222) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4222)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4236): Process ended prematurely: osmo-stp_10.42.42.5(pid=4236) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4236)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4250): Process ended prematurely: osmo-stp_10.42.42.5(pid=4250) [trial-2355↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4250)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4264): Process ended prematurely: osmo-stp_10.42.42.5(pid=4264) [trial-2355↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4264)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=4278): Process ended prematurely: osmo-stp_10.42.42.5(pid=4278) [trial-2355↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4278)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4292): Process ended prematurely: osmo-stp_10.42.42.5(pid=4292) [trial-2355↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4292)] + rm -rf trial-2355/inst + cd trial-2355 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 05:27:51 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355-run.tgz run.2022-12-09_05-28-02 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2355-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2943.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29256.tgz osmo-nitb.build-12964.tgz osmo-pcu-oc2g.build-3906.tgz osmo-pcu-sysmo.build-5188.tgz osmo-pcu.build-5149.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE